-- Logs begin at Mon 2022-07-25 15:27:11 UTC, end at Mon 2022-07-25 16:47:09 UTC. -- Jul 25 16:13:47.690722 dv-cinder-836973-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 16:13:47.701222 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 16:13:47 2022] *** Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: nodename: dv-cinder-836973-15-iscsi Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: machine: x86_64 Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: clock source: unix Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: pcre jit disabled Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: detected number of CPU cores: 4 Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: current working directory: / Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: detected binary path: /usr/bin/uwsgi-core Jul 25 16:13:47.703328 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: your processes number limit is 47680 Jul 25 16:13:47.704869 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: your memory page size is 4096 bytes Jul 25 16:13:47.704869 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: detected max file descriptor number: 2048 Jul 25 16:13:47.704869 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: lock engine: pthread robust mutexes Jul 25 16:13:47.704869 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: thunder lock: enabled Jul 25 16:13:47.704869 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 16:13:47.704869 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 16:13:47.744722 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: Python main interpreter initialized at 0x55f8d44759c0 Jul 25 16:13:47.744722 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: python threads support enabled Jul 25 16:13:47.744722 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: your server socket listen backlog is limited to 100 connections Jul 25 16:13:47.744722 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: your mercy for graceful operations on workers is 90 seconds Jul 25 16:13:47.745255 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 16:13:47.745255 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: *** Operational MODE: preforking *** Jul 25 16:13:47.745518 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: *** uWSGI is running in multiple interpreter mode *** Jul 25 16:13:47.745518 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: spawned uWSGI master process (pid: 103283) Jul 25 16:13:47.745777 dv-cinder-836973-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 16:13:47.749023 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: spawned uWSGI worker 1 (pid: 103284, cores: 1) Jul 25 16:13:47.749023 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: spawned uWSGI worker 2 (pid: 103285, cores: 1) Jul 25 16:13:47.749023 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 16:13:48.472528 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 16:13:48.665979 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 16:13:49.643156 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:13:49.643156 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: from cryptography.utils import int_from_bytes Jul 25 16:13:49.644074 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:13:49.644074 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: from cryptography.utils import int_from_bytes Jul 25 16:13:49.846249 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:13:49.846249 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: from cryptography.utils import int_from_bytes Jul 25 16:13:49.847139 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:13:49.847139 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: from cryptography.utils import int_from_bytes Jul 25 16:13:52.421920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 16:13:52.423066 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 16:13:52.423220 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 16:13:52.423821 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 16:13:52.423988 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 16:13:52.424131 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 16:13:52.424131 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 16:13:52.424382 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 16:13:52.424514 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.424514 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.424759 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 16:13:52.424759 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 16:13:52.424974 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.424974 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.425208 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.425380 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.425511 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.425648 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.425765 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.425896 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.426033 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.426167 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.426296 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.426432 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.426550 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.427185 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.427360 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.427360 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-15-iscsi {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.427636 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.427787 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.427939 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.428078 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.428291 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.428436 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.428583 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.428731 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.428876 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.429037 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.429190 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-15-iscsi {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.429318 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.429508 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.429715 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.429861 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.429991 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.430174 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.430779 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.430779 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.431099 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.431283 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.431468 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.431647 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.431824 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.431824 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.432167 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.432379 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.432513 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.432660 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.432869 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.433023 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.433225 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.433422 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.434153 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.434352 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.434539 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.434726 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.434925 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.435088 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-15-iscsi {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.435279 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.435456 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.435637 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.435819 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.435997 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.436176 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.436353 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.436640 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.436813 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-15-iscsi {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.436990 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.437174 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.437591 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.437800 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.437995 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.441451 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.442527 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.442681 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.442835 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.442979 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.443114 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.443264 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.443434 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.443589 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.443746 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.443902 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.444052 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.444211 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.444353 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.444509 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.444671 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.444820 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.444962 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.445120 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.445280 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.445459 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.445614 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.445777 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.445916 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.446049 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.446180 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.446313 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.446452 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.446589 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.446718 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.446851 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.446978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.447120 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.447258 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.447410 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.447612 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.447768 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.447911 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.448033 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.448169 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.448309 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.448464 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.448616 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.448794 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.448921 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.449072 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.449222 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.449395 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.449559 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.449696 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.449843 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.450001 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.450001 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.450457 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.450654 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.450790 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.450932 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.451098 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.451221 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.451359 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.451513 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.451658 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.451794 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.451940 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.452084 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.452234 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.452234 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.452505 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.452646 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.452803 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.452938 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.453079 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.453225 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.453413 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.453549 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.453701 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.453853 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.454001 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.454157 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.454310 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.454457 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.454591 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.454731 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.454867 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.455009 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.455145 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.455306 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.455445 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.455578 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.455724 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.455876 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.456020 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.456165 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.456295 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.456438 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.456585 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.456711 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.456842 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.456995 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.457141 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.457260 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.457421 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.457564 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.457725 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.457857 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.457997 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.458123 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.458270 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.458400 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.458560 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.458697 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.458818 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.458961 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.459082 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.459255 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.459410 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.459533 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.459666 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.459797 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.459923 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.460075 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.460220 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.460358 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.460483 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.460612 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.460748 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.460865 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.461216 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.461400 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.461543 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.461670 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.461798 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.461936 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.462058 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.462205 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.462324 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.462477 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.462617 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.462756 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.462906 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.463027 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.463181 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.463315 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.463315 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.463595 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.463756 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.463891 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.464049 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.464212 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.464337 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.464591 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.464740 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.464892 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.465025 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.465169 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.465301 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.465631 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.465782 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.465938 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.466073 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.466210 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.466355 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.466511 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.466649 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.466786 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.466929 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.467070 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.467213 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.467361 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.467512 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.467657 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.467801 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.467945 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.468157 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.468330 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.468499 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.468678 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.468864 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.469034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.469225 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.469225 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.469574 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.469747 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.469916 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.470085 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.470272 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.470441 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.470615 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.470615 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.470960 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.470960 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.471482 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.471653 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.471804 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.471979 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.472135 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.472297 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.472480 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.472633 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.472817 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.472973 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.473157 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.473369 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.473538 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.473710 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:13:52.473883 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.474048 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.474218 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.474398 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.474571 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.474745 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.474908 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.475074 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.475226 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.475427 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.475730 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.475902 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.476091 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.476258 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.476434 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.476615 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.476784 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.476935 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.477104 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.477272 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.477572 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.477714 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.477864 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.478002 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.478141 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.478277 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.478421 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.478594 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.478748 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.478897 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.479030 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.479170 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.479321 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.479459 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.479597 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.479734 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.479864 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.480016 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.480158 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.480297 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.480450 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.480591 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.480726 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.480870 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.481025 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.481169 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.481315 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.481581 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.481739 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.481896 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.482036 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.482176 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.482323 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.482465 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.482465 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.482773 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.482908 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.483042 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.483190 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.483346 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.483482 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.483639 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.483783 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.483915 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.484022 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.484165 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.484301 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.484453 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.484590 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.484738 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.484894 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.485037 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.485186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.485327 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.485654 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.485793 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.485967 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.486092 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.486212 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.486370 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.486517 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.486637 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.486776 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.486935 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.487126 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.487297 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.487481 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.487615 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.487748 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.487902 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.488262 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.488418 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.488556 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.488695 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.488832 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.488971 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.489115 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.489255 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.489427 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.489564 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.489719 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.489870 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.490021 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.490165 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.490316 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.490464 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.490598 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.490744 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.490879 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.491022 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.491170 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.491300 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.491436 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.491584 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.491778 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.491921 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.492129 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.492291 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.492441 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.492441 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.492712 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.492848 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.492980 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.492980 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.493245 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.493245 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.493555 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.493691 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.493850 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.493992 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.494149 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.494290 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.494452 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.494452 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.494717 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.494866 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.495021 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.495159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.495294 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.495436 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.495620 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.495759 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.495911 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.496050 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.496187 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.496324 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.496461 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.496610 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.496750 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.496903 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.497041 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.497171 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.497295 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.497465 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.497465 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.497715 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.497842 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.497968 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.498092 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.498229 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.498375 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.498517 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.498637 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.498759 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.498901 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.499060 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.499191 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.499335 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.499480 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.499602 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.499755 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.499902 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.500026 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.500148 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.500292 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.500428 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.500566 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.500707 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.500862 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.500999 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.501138 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.501274 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.501558 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.501684 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.501834 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.502025 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.502158 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.502303 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.502456 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.502599 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.502739 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.502879 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.503016 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.503558 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.503699 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.503839 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.503975 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.504120 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.504269 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.504414 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.504546 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.504753 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.504897 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.505048 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.505177 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.505325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.505485 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.505631 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.505790 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.505924 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.506054 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.506204 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.506346 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.506489 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.506618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.506760 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.506907 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.507043 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.507185 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.507335 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.507335 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.507586 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.507718 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.507845 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.507962 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.508095 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.508211 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.508345 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.508476 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.508598 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.508748 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.508889 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.509022 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.509157 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.509313 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.509561 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.509561 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.509805 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.509953 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.510100 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.510245 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.510382 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.510382 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.510628 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.510779 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.510984 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.511256 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.511429 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.511568 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.511703 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.511839 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.511989 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.512160 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.512298 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.512446 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.512576 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.512694 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.512858 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.513000 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.513131 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.513278 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.513446 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.513573 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.513721 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.513865 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.513998 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.514139 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.514278 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.514427 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.514563 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.514714 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.514852 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.514984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.515133 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.515387 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.515530 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.515666 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.515799 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.515799 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.516046 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.516046 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.516294 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.516294 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.516551 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.516700 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.516822 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.516970 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.517115 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.517237 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.517396 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.517574 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.517767 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.517903 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.518101 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.518276 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.518410 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.518554 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.518704 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.518844 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.518965 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.519091 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.519224 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.519355 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.519497 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.519639 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.519760 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.519898 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.520044 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.520167 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.520306 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.520444 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.520574 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.520702 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.520841 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.520985 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.521118 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.521257 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.521538 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.521538 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.521783 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.521936 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.522073 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.522196 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.522317 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.522454 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.522571 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.522571 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.522835 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.522955 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.523102 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.523212 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.523329 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.523485 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.523618 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.523735 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.523886 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.524008 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.524145 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.524293 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.524418 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.524556 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.524690 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.524837 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.524992 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.525132 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.525273 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.525433 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.525572 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.525716 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.525866 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.526001 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.526149 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.526289 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.526411 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.526535 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.526740 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.526877 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.527008 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.527148 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.527277 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.527413 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.527562 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.527699 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.527843 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.528050 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.528185 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.528326 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.528438 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.528563 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.528685 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.528685 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.528889 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.529028 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.529168 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.529308 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.529535 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.529660 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.529795 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.529952 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.530100 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.530241 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.530369 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.530517 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.530641 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.530769 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.530891 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.531013 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.531146 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.531297 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.531297 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.531623 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.531623 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.531888 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.532027 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.532164 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.532322 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.532457 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.532593 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.532730 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.532871 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.532991 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.533128 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.533258 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.533404 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.533524 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.533661 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.533827 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.533977 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.534128 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.534285 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.534433 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.534552 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.534692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.534829 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.534829 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.535095 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.535234 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.535353 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.535483 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.535623 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.535766 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.535927 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.536067 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.536067 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.536309 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.536432 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.536568 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.536804 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.536941 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.537078 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.537216 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.537459 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.537630 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.537765 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.537900 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.538051 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.538244 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.538377 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.538503 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.538616 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.538736 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.538939 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.539093 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.539230 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.539368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.539368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.539597 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.539712 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.539845 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.539989 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.540129 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.540269 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.540403 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.540403 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.540658 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.540812 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.540944 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.541085 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.541210 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.541376 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.541510 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.541718 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.541861 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.542013 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.542162 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.542310 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.542512 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.542691 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.542829 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.542966 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.543104 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.543243 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.543395 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.543537 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.543663 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.543800 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.543988 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.544135 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.544293 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.544432 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.544587 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.544725 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.544906 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.545055 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.545287 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.545529 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.545687 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.545829 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.545978 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.546108 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.546257 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.546394 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.546567 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.546713 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.546951 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.547120 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.547257 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.547396 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.547571 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.547716 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.547933 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.548084 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.548229 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.548416 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.548601 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.548806 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.548947 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.549142 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.549294 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.549489 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.549630 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.549769 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.549911 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.550061 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.550179 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.550324 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.550470 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.550593 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.550766 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.550917 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.551063 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.551205 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.551353 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.551488 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.551643 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.551777 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.551953 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.552080 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.552237 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.552368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.552543 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.552696 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.552852 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.552987 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.553118 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.553275 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.553465 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.553607 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.553757 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.553903 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.554037 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.554184 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.554328 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.554472 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.554637 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.554779 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.554944 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.555104 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.555241 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.555437 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.555585 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.555738 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.555876 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.556083 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.556238 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.556372 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.556514 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.556653 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.556791 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.556948 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.557093 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.557232 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.557479 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.557618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.557786 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.557936 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.558124 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.558274 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.558408 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.558599 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.558802 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.558945 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.559088 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.559218 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.559337 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.559460 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.559595 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.559718 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.559947 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.560093 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.560254 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.560412 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.560567 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.560744 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.560886 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.561033 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.561166 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.561435 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.561602 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.561740 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.561887 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.562088 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.562230 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.562387 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.562524 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.562672 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.562818 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.562968 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.563107 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.563259 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.563400 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.563562 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.563711 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.563863 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.564016 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.564157 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.564281 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.564416 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.564553 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.564792 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.564949 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.565191 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.565358 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.565560 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.565705 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.565849 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.566009 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.566151 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.566320 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.566474 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.566613 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.566755 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.566898 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.567041 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.567187 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.567322 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.567501 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.567646 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.567856 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.568004 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.568165 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.568317 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.568500 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.568641 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.568851 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.569033 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.569186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.569471 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.570539 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.572924 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.573086 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.573247 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.573410 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.573553 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.573763 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.573936 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.574077 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.574198 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.574351 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.574497 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.574497 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.574761 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.574900 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.574900 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.575165 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.575302 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.575439 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.575577 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.575577 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.575860 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.575990 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.576132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.576132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.576409 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.576409 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.576659 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.576659 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.576927 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.576927 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.577189 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.577319 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.577581 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.577775 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.577916 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.578066 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.578214 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.578365 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.578501 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.578636 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.578775 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.578922 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.579039 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.579155 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.579269 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.579392 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.579517 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.579633 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.579756 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.579894 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.580038 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.580177 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.580177 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.580420 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.580551 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.580684 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.580837 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.580980 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.580980 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.581224 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.581377 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.581500 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.581626 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.581749 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.581914 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.582069 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.582211 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.582403 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.582593 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.582750 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.582890 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.583029 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.583140 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.583253 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.583401 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.583555 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.583704 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.583814 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.583945 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.584086 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.584232 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.584387 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.584387 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.584636 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.584791 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.584933 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.585084 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.585232 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.585406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.585546 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.585729 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.585865 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.585993 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.586116 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.586263 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.586418 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.586556 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.586556 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.586814 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.586950 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.587089 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.587213 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.587369 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.587369 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.587636 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.587758 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.587913 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.588051 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.588288 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.588416 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.588611 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.588747 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.589013 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.589160 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.589422 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.589547 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.589714 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.589843 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.590044 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.590190 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.590361 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.590526 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.590679 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.590832 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.591046 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.591190 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.591356 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.591543 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.591689 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.591893 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.592049 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.592257 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.592398 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.592534 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.592640 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.592840 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.592990 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.593131 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.593268 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.593492 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.593642 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.593799 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.593952 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.594099 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.594245 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.594392 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.594521 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.594696 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.594841 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.595009 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.595154 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.595300 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.595446 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.595603 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.595754 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.595896 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.596100 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.596244 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.596395 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.596535 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.596722 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.596861 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.597031 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.597186 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.597433 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.597575 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.597712 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.597846 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.598004 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.598157 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.598298 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.598439 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.598579 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.598721 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.598911 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.599083 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.599238 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.599386 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.599578 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.599759 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.599901 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.600113 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.600271 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.600449 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.600594 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.600731 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.600879 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.601031 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.601168 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.601322 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.601482 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.601663 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.601812 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.601967 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.602181 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.602312 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.602527 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.602661 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.602843 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.602962 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.603160 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.603300 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.603438 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.603575 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.603758 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.603904 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.604070 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.604198 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.604370 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.604496 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.604652 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.604932 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.605060 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.605179 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.605390 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.605564 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.605709 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.605847 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.606016 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.606159 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.606333 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.606553 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.606684 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.606804 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.606943 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.607061 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.607259 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.607416 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.607564 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.607707 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.607879 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.608010 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.608194 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.608351 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.608490 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.608629 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.608807 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.608954 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.609168 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.609309 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.609549 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.609714 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.609846 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.609960 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.610187 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.610307 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.610524 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.610656 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.610880 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.611026 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.611215 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.611359 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.611564 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.611813 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.611970 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.612120 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.612257 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.612434 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.612602 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.612730 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.612974 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.613109 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.613307 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.613560 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.613681 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.613800 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.614015 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.614270 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.614418 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.614559 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.614709 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.614848 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.615025 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.615170 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.615360 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.615504 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.615681 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.615906 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.616052 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.616328 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.616553 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.616715 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.616885 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.617033 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.617183 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.617372 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.617518 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.617658 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.617839 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.617971 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.618187 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.618313 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.618574 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.618760 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.618900 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.619053 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.619189 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.619323 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.619657 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.619805 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.620053 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.620194 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.620368 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.620593 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.620726 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.620928 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.621087 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.621290 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.621513 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.621658 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.621796 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.621952 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.622207 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.622353 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.622470 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.622590 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.622765 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.622914 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.623180 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.623324 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.623468 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.623591 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.623787 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.623941 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.624076 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.624217 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.624547 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.624684 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.624891 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.625025 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.625211 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.625387 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.625583 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.625727 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.625937 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.626114 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.626258 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.626377 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.626560 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.626707 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.626889 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.627077 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.627236 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.627396 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.627525 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.627712 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.627861 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.628024 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.628155 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.628721 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.628853 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.629040 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.629183 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.629380 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.629528 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.629683 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.629898 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.630029 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.630241 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.630370 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.630704 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.630905 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.631207 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.631359 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.631524 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.631652 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.631853 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.631995 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.632177 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.632315 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.632526 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.632663 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.632835 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.632962 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.633161 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.633410 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.633578 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.633716 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.633857 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.634006 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.634143 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.634292 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.634442 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.634582 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.634720 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.634900 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.635058 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.635196 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.635342 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.635549 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.635692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.635855 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.636007 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.636251 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.636421 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.636662 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.636840 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.636992 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.637163 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.637305 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.637605 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.637786 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.637939 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.638141 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.638299 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.638490 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.638618 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.638792 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.638932 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.639090 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.639230 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.639370 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.639646 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.639791 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.639966 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.640122 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.640260 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.640427 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.640556 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.640738 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.640870 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.641043 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.641174 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.641467 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.641618 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.641821 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.641994 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.642161 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.642286 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.642422 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.642542 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.642720 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.642863 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.643040 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.643174 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.643345 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.643524 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.643659 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.643812 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.643967 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.644108 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.644279 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.644413 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.644634 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.644797 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.644952 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.645090 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.645230 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.645557 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.645708 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.645864 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.646002 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.646138 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.646274 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.646520 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.646674 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.646848 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.647003 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.647147 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.647285 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.647437 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.647604 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.647737 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.647873 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.648023 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.648162 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.648328 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.648484 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.648621 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.648761 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.648930 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.649077 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.649238 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.649583 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.649736 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.649875 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.650030 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.650172 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.650323 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.650462 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.650588 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.650720 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.650845 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.651030 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.651196 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.651338 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.651476 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.651625 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.651815 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.651959 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.652112 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.652256 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.652394 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.652591 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.652742 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.653007 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.653201 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.653373 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.653519 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.653714 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.653864 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.654035 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.654177 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.654318 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.654467 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.654620 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.654760 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.654912 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.655051 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.655201 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.655340 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.655515 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.655662 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.655847 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.655976 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.656159 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.656288 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.656474 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.656615 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.657113 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.657263 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.657421 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.657546 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.657670 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.657809 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.657948 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.658083 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.658224 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.658423 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.658567 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.658721 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.658862 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.659005 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.659152 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.659306 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.659471 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.659626 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.659767 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.659923 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.660180 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.660305 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.660759 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.660898 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.661091 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.661300 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.661537 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.661672 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.661827 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.661936 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.662005 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.662199 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.662337 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.662622 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.662776 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.662964 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.663057 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.663312 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.663463 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.663615 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.663753 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.663938 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.664069 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.664249 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.664385 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.664582 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.664733 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.665015 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.665162 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.665300 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.665546 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.665691 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.665880 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.666026 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.666179 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.666316 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.666499 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.666646 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.666801 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.666940 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.667120 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.667611 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.667978 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.668287 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.668413 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.668660 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.668785 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.668966 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.669103 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.669272 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.669472 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.669596 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.669711 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.670022 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.670160 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.670523 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.670685 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.670892 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.671093 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.671288 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.671435 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.671602 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.671738 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.671913 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.672131 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.672300 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.672440 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.672571 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.672855 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.673018 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.673155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.673292 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.673526 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.673671 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.673809 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.673965 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.674079 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.674268 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.674426 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.674599 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.674727 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.674958 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.675102 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.675269 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.675398 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.675576 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.675704 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.675861 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.676018 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.676150 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.676272 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.676465 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.676607 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.676758 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.676883 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.677060 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.677196 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.677453 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.677613 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.677770 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.677895 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.678089 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.678234 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.678403 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.678561 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.678699 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.678832 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.679051 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.679197 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.679469 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.679637 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.679873 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.680005 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.680217 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.680570 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.680739 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.680885 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.681022 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.681220 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.681457 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.681614 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.681821 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.681973 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.682235 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.682382 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.682555 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.682702 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.682878 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.683102 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.683254 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.683471 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.683629 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.683888 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.684047 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.684203 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.684331 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.684529 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.684683 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.684961 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.685086 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.685239 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.685410 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.685623 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.685784 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.686022 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.686170 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.686387 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.686556 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.686711 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.686853 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.687015 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.687140 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.687290 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 16:13:52.687443 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.687762 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.688104 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.688433 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.688755 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.689070 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.689438 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.689747 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.690067 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.690379 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.690709 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.691094 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.691443 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.691844 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.692169 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.692491 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.692845 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.693216 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.693593 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.693996 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.694332 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.694662 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.695019 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.695431 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.695785 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.696125 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.696478 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.696777 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.697090 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:13:52.697373 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 16:13:52.859921 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO dbcounter [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Registered counter for database nova_api Jul 25 16:13:52.875415 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO dbcounter [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Registered counter for database nova_api Jul 25 16:13:52.883864 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG oslo_db.sqlalchemy.engines [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:13:52.894387 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writer thread running {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:13:52.899392 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_db.sqlalchemy.engines [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:13:52.907343 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writer thread running {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:13:52.968980 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.context [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3(cell1) {{(pid=103285) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 16:13:52.973686 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.975451 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.976352 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:52.978697 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:52.980877 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO dbcounter [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Registered counter for database nova_cell0 Jul 25 16:13:52.987342 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO dbcounter [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Registered counter for database nova_cell1 Jul 25 16:13:52.996795 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_db.sqlalchemy.engines [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:13:52.998864 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_db.sqlalchemy.engines [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:13:53.000058 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.context [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3(cell1) {{(pid=103284) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 16:13:53.007237 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writer thread running {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:13:53.008336 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG oslo_concurrency.lockutils [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:53.008657 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writer thread running {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:13:53.011575 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG oslo_concurrency.lockutils [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:53.013033 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG oslo_concurrency.lockutils [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:13:53.017039 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG oslo_concurrency.lockutils [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:13:53.021271 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO dbcounter [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Registered counter for database nova_cell0 Jul 25 16:13:53.032230 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO dbcounter [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Registered counter for database nova_cell1 Jul 25 16:13:53.044500 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG oslo_db.sqlalchemy.engines [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:13:53.046076 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG oslo_db.sqlalchemy.engines [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:13:53.058273 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writer thread running {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:13:53.060786 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writer thread running {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:13:53.165565 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO dbcounter [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Registered counter for database nova_cell0 Jul 25 16:13:53.173999 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_db.sqlalchemy.engines [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:13:53.179622 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writer thread running {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:13:53.341772 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO dbcounter [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Registered counter for database nova_cell0 Jul 25 16:13:53.352871 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG oslo_db.sqlalchemy.engines [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:13:53.360004 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writer thread running {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:13:53.543629 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: WARNING keystonemiddleware.auth_token [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:13:53.551894 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: WARNING keystonemiddleware.auth_token [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:13:53.714449 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: WARNING keystonemiddleware.auth_token [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:13:53.722672 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: WARNING keystonemiddleware.auth_token [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:13:53.918279 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: WARNING keystonemiddleware.auth_token [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:13:53.924998 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: WARNING keystonemiddleware.auth_token [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:13:53.931526 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f8d44759c0 pid: 103285 (default app) Jul 25 16:13:53.934135 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:13:53.935562 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002187 Jul 25 16:13:53.936042 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Mon Jul 25 16:13:53 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:13:54.096387 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: WARNING keystonemiddleware.auth_token [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:13:54.102774 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: WARNING keystonemiddleware.auth_token [None req-7327a424-2276-44a0-89b5-e8c919c95142 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:13:54.108631 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f8d44759c0 pid: 103284 (default app) Jul 25 16:15:33.415163 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:33.416861 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002352 Jul 25 16:15:33.417804 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:15:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:33.450795 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_api:SELECT=3 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:33.454205 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_cell0:SELECT=3 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:33.455651 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_cell1:SELECT=3 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:33.457594 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_cell0:SELECT=3 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:34.867901 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-63b3ee04-d613-48b9-8fac-abbaa329a95d admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:34.911212 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-63b3ee04-d613-48b9-8fac-abbaa329a95d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.479991 Jul 25 16:15:34.914072 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 25 16:15:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:37.914482 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:37.916618 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-97a9d160-2a6b-4782-933d-cc20c488f34d None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Jul 25 16:15:37.917457 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:38.679873 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-7c53eaa7-f401-4932-8036-45b49fd8085b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "disk": 1}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:38.719714 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:15:38.719714 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: warnings.warn(msg) Jul 25 16:15:38.776924 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-7c53eaa7-f401-4932-8036-45b49fd8085b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.848704 Jul 25 16:15:38.778232 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:15:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:15:38.802092 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=3 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:38.804171 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell1:SELECT=3 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:38.805655 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell0:SELECT=3 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:38.807099 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:15:39.056976 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-b0f85f4d-9fca-449f-a013-fca9952b906e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:39.062168 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:15:39.062168 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 25 16:15:39.140093 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-b0f85f4d-9fca-449f-a013-fca9952b906e admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348198 Jul 25 16:15:39.141801 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 25 16:15:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:42.198041 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-7c53eaa7-f401-4932-8036-45b49fd8085b admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:42.199315 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-7c53eaa7-f401-4932-8036-45b49fd8085b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001882 Jul 25 16:15:42.200126 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:15:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:15:43.193610 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-4f679f4c-6076-4d94-9615-2bfa6113f69b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "d1", "name": "ds512M"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:43.229103 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:15:43.229103 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 25 16:15:43.264086 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-4f679f4c-6076-4d94-9615-2bfa6113f69b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.056081 Jul 25 16:15:43.273937 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:15:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:15:43.285001 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3af17204-d7df-41b9-96e1-b29fab525438 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:43.290283 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:15:43.290283 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: warnings.warn(msg) Jul 25 16:15:43.355028 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3af17204-d7df-41b9-96e1-b29fab525438 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076252 Jul 25 16:15:43.356309 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 25 16:15:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:46.784270 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-4f679f4c-6076-4d94-9615-2bfa6113f69b admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:46.786309 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-4f679f4c-6076-4d94-9615-2bfa6113f69b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002536 Jul 25 16:15:46.786954 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:47.506417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-6204772a-03fb-4d79-a288-1411ade1ba60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "ram": 1024, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:47.538468 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-6204772a-03fb-4d79-a288-1411ade1ba60 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.739903 Jul 25 16:15:47.539529 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:15:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:15:47.560467 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-3acd46db-81d4-4175-b7ff-88874fc1352e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:47.605424 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-3acd46db-81d4-4175-b7ff-88874fc1352e admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055268 Jul 25 16:15:47.606633 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 25 16:15:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:51.331867 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-6204772a-03fb-4d79-a288-1411ade1ba60 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:51.336658 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-6204772a-03fb-4d79-a288-1411ade1ba60 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003579 Jul 25 16:15:51.337464 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:15:51 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:15:52.008648 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-b0de8367-8735-4964-bb99-b633eb0039c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:52.035047 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-b0de8367-8735-4964-bb99-b633eb0039c4 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.687742 Jul 25 16:15:52.037435 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:15:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:15:52.056578 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-cc36ad16-54f2-40b3-84f4-71ec4f83963d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:52.095797 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-cc36ad16-54f2-40b3-84f4-71ec4f83963d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046405 Jul 25 16:15:52.096919 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 25 16:15:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:55.361576 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-b0de8367-8735-4964-bb99-b633eb0039c4 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:55.362774 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-b0de8367-8735-4964-bb99-b633eb0039c4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jul 25 16:15:55.363439 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:15:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:15:56.060208 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-9d3bba7f-1d4b-4277-9d67-8ec72f8fd477 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "swap": 0}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:56.088512 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-9d3bba7f-1d4b-4277-9d67-8ec72f8fd477 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.714074 Jul 25 16:15:56.089317 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:15:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:15:56.105324 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-71471027-1a4d-42bc-94bd-d9c138983663 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:15:56.139572 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-71471027-1a4d-42bc-94bd-d9c138983663 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039272 Jul 25 16:15:56.140685 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Jul 25 16:15:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:15:59.261527 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-9d3bba7f-1d4b-4277-9d67-8ec72f8fd477 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:59.262970 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-9d3bba7f-1d4b-4277-9d67-8ec72f8fd477 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 Jul 25 16:15:59.263762 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:15:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:15:59.950284 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-94bb30d0-bcb9-4604-a9cb-9443d3cc4fcd admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:15:59.979725 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-94bb30d0-bcb9-4604-a9cb-9443d3cc4fcd admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.704973 Jul 25 16:15:59.986868 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 25 16:15:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:16:03.073832 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-9d3bba7f-1d4b-4277-9d67-8ec72f8fd477 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:03.075742 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-9d3bba7f-1d4b-4277-9d67-8ec72f8fd477 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002602 Jul 25 16:16:03.076546 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:03.832787 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-97f8a620-a20e-476d-87db-37ea9cf08846 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:03.868905 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-97f8a620-a20e-476d-87db-37ea9cf08846 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.781802 Jul 25 16:16:03.881375 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:16:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:03.892807 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-0633bd90-c314-44a0-95bd-6f8cbe1538fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:03.902514 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:03.947066 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-0633bd90-c314-44a0-95bd-6f8cbe1538fd admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061373 Jul 25 16:16:03.947999 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 25 16:16:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:16:07.120323 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-97f8a620-a20e-476d-87db-37ea9cf08846 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:07.121705 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-97f8a620-a20e-476d-87db-37ea9cf08846 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Jul 25 16:16:07.122285 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:16:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:07.796435 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-33a11767-d8c0-4257-a088-a3c7d519a050 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:07.835543 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-33a11767-d8c0-4257-a088-a3c7d519a050 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.702925 Jul 25 16:16:07.838086 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:16:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:07.865037 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-b029c3b1-49ef-4076-915a-735047b6a0bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:07.918403 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-b029c3b1-49ef-4076-915a-735047b6a0bc admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060042 Jul 25 16:16:07.919428 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 25 16:16:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:16:11.131149 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-33a11767-d8c0-4257-a088-a3c7d519a050 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:11.133920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-33a11767-d8c0-4257-a088-a3c7d519a050 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003477 Jul 25 16:16:11.135030 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:11.998157 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-0ce2f1ce-a68a-43d9-aa0b-d37afad98767 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:12.011422 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:12.041694 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-0ce2f1ce-a68a-43d9-aa0b-d37afad98767 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.895396 Jul 25 16:16:12.042991 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:16:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:12.059874 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-b1e47258-b824-495c-b3e7-c5845cd0e7e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:12.100194 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-b1e47258-b824-495c-b3e7-c5845cd0e7e8 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044904 Jul 25 16:16:12.101468 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 25 16:16:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:15.160202 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-0ce2f1ce-a68a-43d9-aa0b-d37afad98767 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:15.161822 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-0ce2f1ce-a68a-43d9-aa0b-d37afad98767 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004601 Jul 25 16:16:15.165755 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:15.995056 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-7e216d2b-40f3-4689-bc98-cbf3e4b9a132 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "swap": 0, "disk": 80}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:16.034191 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-7e216d2b-40f3-4689-bc98-cbf3e4b9a132 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.862959 Jul 25 16:16:16.035783 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:16:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:16.057076 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-1d642866-c941-4b14-b40e-0d0a78b2cb51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:16.110426 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-1d642866-c941-4b14-b40e-0d0a78b2cb51 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060389 Jul 25 16:16:16.125047 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 25 16:16:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:16:19.934912 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-7e216d2b-40f3-4689-bc98-cbf3e4b9a132 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:19.936680 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-7e216d2b-40f3-4689-bc98-cbf3e4b9a132 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002432 Jul 25 16:16:19.937455 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:16:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:20.745170 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-f32b265d-5bc8-4bf6-ba02-bdbc5ce3a403 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:20.779771 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-f32b265d-5bc8-4bf6-ba02-bdbc5ce3a403 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.831319 Jul 25 16:16:20.780689 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Jul 25 16:16:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:20.795915 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-b65afbac-f626-4b7a-9d4e-e7cbba45a4e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:20.840444 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-b65afbac-f626-4b7a-9d4e-e7cbba45a4e5 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048779 Jul 25 16:16:20.865387 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Jul 25 16:16:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:16:43.569261 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-f32b265d-5bc8-4bf6-ba02-bdbc5ce3a403 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:43.570431 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-f32b265d-5bc8-4bf6-ba02-bdbc5ce3a403 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Jul 25 16:16:43.570938 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:16:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:43.587222 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:44.123308 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-ba353d7f-4563-44cf-8cb8-b83338e654f1 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:44.144063 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-ba353d7f-4563-44cf-8cb8-b83338e654f1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.565520 Jul 25 16:16:44.144778 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 25 16:16:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:16:45.728962 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-f32b265d-5bc8-4bf6-ba02-bdbc5ce3a403 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:45.731020 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-f32b265d-5bc8-4bf6-ba02-bdbc5ce3a403 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002709 Jul 25 16:16:45.731816 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:46.632541 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-815b0d4e-3f79-4561-a11d-0c72e3963ab5 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:46.643033 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.wsgi [None req-815b0d4e-3f79-4561-a11d-0c72e3963ab5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-815b0d4e-3f79-4561-a11d-0c72e3963ab5 admin admin] Request method failure captured: Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Accept: application/json Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Accept-Encoding: gzip, deflate Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Connection: keep-alive Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Content-Length: 0 Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Host: 10.222.0.66 Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Openstack-Api-Version: compute 2.90 Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Openstack-System-Scope: None Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: User-Agent: python-novaclient Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Auth-Token: gAAAAABi3sHtb-8mPZyvkotThhNZ8M27qVDvorphigfO5IhvDAYjSOkf9peyd0s_lhCxRg5Tvni6x3Jk4DThds4h3aGldWWcw-GDgZ_GpASkEPSqm6EskVdZd1M2Lxb3o2VEMIbn9X5TCBhvhcpGUc1LmZUBW9cZ5P8y52fsGrOpjJ7Pr0kFLFw Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Domain-Id: None Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Domain-Name: None Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Identity-Status: Confirmed Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Is-Admin-Project: True Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Domain-Id: default Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Domain-Name: Default Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Name: admin Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Role: admin,member,reader Jul 25 16:16:46.648618 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Roles: admin,member,reader Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}] Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Tenant: admin Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Tenant-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Tenant-Name: admin Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User: admin Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Domain-Id: default Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Domain-Name: Default Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Id: 3c939fd3ba4449cf949d6e5bd73effec Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Name: admin Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: method: > Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: exception: Flavor 42 could not be found. Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: action_args: {'id': '42'} Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:46.650332 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:46.651417 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.652920 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-815b0d4e-3f79-4561-a11d-0c72e3963ab5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:46.654591 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-815b0d4e-3f79-4561-a11d-0c72e3963ab5 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.765274 Jul 25 16:16:46.654591 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 25 16:16:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 767 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 16:16:46.664038 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-61208bcc-8ff0-41e5-9061-40af6dd25216 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:46.668709 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:16:46.693427 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-61208bcc-8ff0-41e5-9061-40af6dd25216 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033841 Jul 25 16:16:46.694044 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 25 16:16:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:16:46.705472 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f8505477-ea9a-413f-8e0e-f3938e5fd954 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:46.735472 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f8505477-ea9a-413f-8e0e-f3938e5fd954 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034310 Jul 25 16:16:46.736067 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 25 16:16:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:16:46.750903 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-7757143c-cf33-4285-b0d3-acf9310bc877 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:46.762355 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.wsgi [None req-7757143c-cf33-4285-b0d3-acf9310bc877 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-7757143c-cf33-4285-b0d3-acf9310bc877 admin admin] Request method failure captured: Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Accept: application/json Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Accept-Encoding: gzip, deflate Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Connection: keep-alive Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Content-Length: 0 Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Host: 10.222.0.66 Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Openstack-Api-Version: compute 2.90 Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Openstack-System-Scope: None Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: User-Agent: python-novaclient Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Auth-Token: gAAAAABi3sHtb-8mPZyvkotThhNZ8M27qVDvorphigfO5IhvDAYjSOkf9peyd0s_lhCxRg5Tvni6x3Jk4DThds4h3aGldWWcw-GDgZ_GpASkEPSqm6EskVdZd1M2Lxb3o2VEMIbn9X5TCBhvhcpGUc1LmZUBW9cZ5P8y52fsGrOpjJ7Pr0kFLFw Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Domain-Id: None Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Domain-Name: None Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Identity-Status: Confirmed Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Is-Admin-Project: True Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Domain-Id: default Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Domain-Name: Default Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Name: admin Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Role: admin,member,reader Jul 25 16:16:46.771600 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Roles: admin,member,reader Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}] Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Tenant: admin Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Tenant-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Tenant-Name: admin Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User: admin Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Domain-Id: default Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Domain-Name: Default Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Id: 3c939fd3ba4449cf949d6e5bd73effec Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Name: admin Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: method: > Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: exception: Flavor 42 could not be found. Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: action_args: {'id': '42'} Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:46.774325 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:46.776186 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:46.778328 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-7757143c-cf33-4285-b0d3-acf9310bc877 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:46.780458 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-7757143c-cf33-4285-b0d3-acf9310bc877 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.031681 Jul 25 16:16:46.780458 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 25 16:16:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:16:47.907136 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f8505477-ea9a-413f-8e0e-f3938e5fd954 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:47.909068 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f8505477-ea9a-413f-8e0e-f3938e5fd954 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002439 Jul 25 16:16:47.909941 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:16:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:48.745920 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e6f5e8f5-8ef7-4aff-900c-3842f6beb7f2 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.753265 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.wsgi [None req-e6f5e8f5-8ef7-4aff-900c-3842f6beb7f2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e6f5e8f5-8ef7-4aff-900c-3842f6beb7f2 admin admin] Request method failure captured: Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Accept: application/json Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Accept-Encoding: gzip, deflate Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Connection: keep-alive Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Content-Length: 0 Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Host: 10.222.0.66 Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Openstack-Api-Version: compute 2.90 Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Openstack-System-Scope: None Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: User-Agent: python-novaclient Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Auth-Token: gAAAAABi3sHvEphrImf0sp_UiUAlpjLJXitB8sZt4drKCu2WRuksefZk8RoJu5OEQXLtKqJmusOp_dbLfQ8BUfbgJtnKknZ7ePP33NfpCmGVjwfdUNk9h42hczFLbNUcrr1VzfdaYLzLaLUzeyof66ie1vWKutt_QR3sxdGlbloCjRI3zrvfl38 Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Domain-Id: None Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Domain-Name: None Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Identity-Status: Confirmed Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Is-Admin-Project: True Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Domain-Id: default Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Domain-Name: Default Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Name: admin Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Role: admin,member,reader Jul 25 16:16:48.755293 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Roles: admin,member,reader Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}] Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Tenant: admin Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Tenant-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Tenant-Name: admin Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User: admin Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Domain-Id: default Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Domain-Name: Default Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Id: 3c939fd3ba4449cf949d6e5bd73effec Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Name: admin Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: method: > Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: exception: Flavor 84 could not be found. Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: action_args: {'id': '84'} Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:48.758132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.759984 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.764078 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e6f5e8f5-8ef7-4aff-900c-3842f6beb7f2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:48.766801 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e6f5e8f5-8ef7-4aff-900c-3842f6beb7f2 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.692509 Jul 25 16:16:48.766801 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 695 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:16:48.772014 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-24192ea4-27cc-45cf-92eb-58696fee5a27 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.790639 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-24192ea4-27cc-45cf-92eb-58696fee5a27 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022849 Jul 25 16:16:48.791284 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:16:48.803084 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-1dc19c1a-86e7-4c26-bd10-25d2c2c4d8df admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.821132 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-1dc19c1a-86e7-4c26-bd10-25d2c2c4d8df admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022597 Jul 25 16:16:48.821773 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:16:48.836980 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-706a494b-919e-4c0e-b29e-2c22fcd913d0 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:48.847018 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.wsgi [None req-706a494b-919e-4c0e-b29e-2c22fcd913d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-706a494b-919e-4c0e-b29e-2c22fcd913d0 admin admin] Request method failure captured: Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Accept: application/json Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Accept-Encoding: gzip, deflate Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Connection: keep-alive Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Content-Length: 0 Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Host: 10.222.0.66 Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Openstack-Api-Version: compute 2.90 Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Openstack-System-Scope: None Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: User-Agent: python-novaclient Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Auth-Token: gAAAAABi3sHvEphrImf0sp_UiUAlpjLJXitB8sZt4drKCu2WRuksefZk8RoJu5OEQXLtKqJmusOp_dbLfQ8BUfbgJtnKknZ7ePP33NfpCmGVjwfdUNk9h42hczFLbNUcrr1VzfdaYLzLaLUzeyof66ie1vWKutt_QR3sxdGlbloCjRI3zrvfl38 Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Domain-Id: None Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Domain-Name: None Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Identity-Status: Confirmed Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Is-Admin-Project: True Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Domain-Id: default Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Domain-Name: Default Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Name: admin Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Role: admin,member,reader Jul 25 16:16:48.849957 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Roles: admin,member,reader Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}] Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Tenant: admin Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Tenant-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Tenant-Name: admin Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User: admin Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Domain-Id: default Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Domain-Name: Default Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Id: 3c939fd3ba4449cf949d6e5bd73effec Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Name: admin Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: method: > Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: exception: Flavor 84 could not be found. Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: action_args: {'id': '84'} Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:48.852399 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.853694 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:48.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-706a494b-919e-4c0e-b29e-2c22fcd913d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:48.858450 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-706a494b-919e-4c0e-b29e-2c22fcd913d0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.022810 Jul 25 16:16:48.858450 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Jul 25 16:16:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 16:16:50.065276 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-1dc19c1a-86e7-4c26-bd10-25d2c2c4d8df admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:50.066351 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-1dc19c1a-86e7-4c26-bd10-25d2c2c4d8df admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 25 16:16:50.066777 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:16:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:16:50.920317 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-dc75d4d9-ffab-4f9c-9b5c-b18fb874d817 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:50.930939 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.wsgi [None req-dc75d4d9-ffab-4f9c-9b5c-b18fb874d817 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-dc75d4d9-ffab-4f9c-9b5c-b18fb874d817 admin admin] Request method failure captured: Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Accept: application/json Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Accept-Encoding: gzip, deflate Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Connection: keep-alive Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Content-Length: 0 Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Host: 10.222.0.66 Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Openstack-Api-Version: compute 2.90 Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Openstack-System-Scope: None Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: User-Agent: python-novaclient Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Auth-Token: gAAAAABi3sHx95TxlpYdsdaL14EZO-rpMsm7XIXxa2q-c8CsydKk4cYFKTS1xdXBBwZsCxahca-fLQbCqn3Oa8dHJe-iVjE0uKKyQlQSaFlaoGlJkf9Z4RrnHmznyfS_tcA8pwZUlaltDGwpGs9L3T5WEzABR214Yn49MBwTI-SLbLS6pnuVijU Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Domain-Id: None Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Domain-Name: None Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Identity-Status: Confirmed Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Is-Admin-Project: True Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Domain-Id: default Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Domain-Name: Default Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Project-Name: admin Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Role: admin,member,reader Jul 25 16:16:50.933978 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Roles: admin,member,reader Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}] Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Tenant: admin Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Tenant-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-Tenant-Name: admin Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User: admin Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Domain-Id: default Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Domain-Name: Default Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Id: 3c939fd3ba4449cf949d6e5bd73effec Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: X-User-Name: admin Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: method: > Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: exception: Flavor 451 could not be found. Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: action_args: {'id': '451'} Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:50.936406 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:50.938034 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 25 16:16:50.940159 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-dc75d4d9-ffab-4f9c-9b5c-b18fb874d817 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:50.942227 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-dc75d4d9-ffab-4f9c-9b5c-b18fb874d817 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.721007 Jul 25 16:16:50.942227 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 25 16:16:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 723 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 16:16:50.953622 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e67aa68e-44cd-4c4f-863c-35183f00e11d admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:50.976007 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e67aa68e-44cd-4c4f-863c-35183f00e11d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029093 Jul 25 16:16:50.976646 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 25 16:16:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:16:50.994904 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:51.030479 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.042178 Jul 25 16:16:51.031536 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Jul 25 16:16:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:16:51.045592 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-f8d7942f-4d2c-4c0c-8973-0d60181abd00 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:51.052704 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.wsgi [None req-f8d7942f-4d2c-4c0c-8973-0d60181abd00 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-f8d7942f-4d2c-4c0c-8973-0d60181abd00 admin admin] Request method failure captured: Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Accept: application/json Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Accept-Encoding: gzip, deflate Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Connection: keep-alive Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Content-Length: 0 Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Host: 10.222.0.66 Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Openstack-Api-Version: compute 2.90 Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Openstack-System-Scope: None Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: User-Agent: python-novaclient Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Auth-Token: gAAAAABi3sHx95TxlpYdsdaL14EZO-rpMsm7XIXxa2q-c8CsydKk4cYFKTS1xdXBBwZsCxahca-fLQbCqn3Oa8dHJe-iVjE0uKKyQlQSaFlaoGlJkf9Z4RrnHmznyfS_tcA8pwZUlaltDGwpGs9L3T5WEzABR214Yn49MBwTI-SLbLS6pnuVijU Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Domain-Id: None Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Domain-Name: None Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Identity-Status: Confirmed Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Is-Admin-Project: True Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Domain-Id: default Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Domain-Name: Default Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Project-Name: admin Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Role: admin,member,reader Jul 25 16:16:51.054692 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Roles: admin,member,reader Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8ee5c3834cf43d4a8d8dd7aee49ae24"}]}] Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Tenant: admin Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Tenant-Id: b8ee5c3834cf43d4a8d8dd7aee49ae24 Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-Tenant-Name: admin Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User: admin Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Domain-Id: default Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Domain-Name: Default Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Id: 3c939fd3ba4449cf949d6e5bd73effec Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: X-User-Name: admin Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: method: > Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: exception: Flavor 451 could not be found. Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: action_args: {'id': '451'} Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:16:51.059368 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:51.061155 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 25 16:16:51.063644 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-f8d7942f-4d2c-4c0c-8973-0d60181abd00 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:16:51.066787 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-f8d7942f-4d2c-4c0c-8973-0d60181abd00 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015187 Jul 25 16:16:51.067314 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 25 16:16:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 16:16:52.392298 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:52.393842 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002279 Jul 25 16:16:52.394390 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:16:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:53.108700 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-862e75fd-de1d-4975-a3fc-1b44af20f58b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:53.139238 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-862e75fd-de1d-4975-a3fc-1b44af20f58b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.590340 Jul 25 16:16:53.139826 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 25 16:16:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 16:16:54.294667 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:54.296490 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002536 Jul 25 16:16:54.297218 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:55.059456 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-90c37ca7-08a2-48c3-9cd0-160d3f3aeb51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:55.081654 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-90c37ca7-08a2-48c3-9cd0-160d3f3aeb51 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.560058 Jul 25 16:16:55.082756 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 25 16:16:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:56.162949 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:56.163970 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 25 16:16:56.164514 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:16:56.849188 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-9c2d7e19-e163-4665-a0df-116e869bc0c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:56.879939 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-9c2d7e19-e163-4665-a0df-116e869bc0c2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.571885 Jul 25 16:16:56.880945 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 25 16:16:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:58.013919 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:58.014947 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 25 16:16:58.015409 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:16:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:16:58.678761 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e35818b0-e26f-474a-8eda-077378a56596 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:16:58.704275 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e35818b0-e26f-474a-8eda-077378a56596 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.542745 Jul 25 16:16:58.705042 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Jul 25 16:16:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:16:59.831275 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:16:59.832780 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 Jul 25 16:16:59.833409 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:16:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:17:00.518732 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-40726777-4cbb-43fe-a2d7-1eefdd7c3eca admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:17:00.558816 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-40726777-4cbb-43fe-a2d7-1eefdd7c3eca admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.575011 Jul 25 16:17:00.559819 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Mon Jul 25 16:16:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:18:13.821383 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:13.822431 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3f0097f9-4a2a-494f-a4ce-658c9d625d81 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 25 16:18:13.822846 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 930 bytes} [Mon Jul 25 16:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:18:13.835232 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:14.366232 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-94e23bc3-6191-4fcb-997e-f3f43f621a99 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.388402 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-94e23bc3-6191-4fcb-997e-f3f43f621a99 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.555150 Jul 25 16:18:14.389435 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Jul 25 16:18:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:18:14.411826 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_api:SELECT=14 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:18:14.415676 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-0068afc4-ffdd-4b22-b113-f2aa1bb5cc0d admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.424323 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-0068afc4-ffdd-4b22-b113-f2aa1bb5cc0d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013928 Jul 25 16:18:14.424904 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1282 bytes} [Mon Jul 25 16:18:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:14.437490 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-a80718f6-4b35-4924-bac7-198f6391adbc admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.446205 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-a80718f6-4b35-4924-bac7-198f6391adbc admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012441 Jul 25 16:18:14.446796 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1285 bytes} [Mon Jul 25 16:18:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:14.463820 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.474922 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018507 Jul 25 16:18:14.475551 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1285 bytes} [Mon Jul 25 16:18:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:18:14.488358 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-2a35de7d-0306-4281-90ba-b00c7a9ed82f admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:18:14.496950 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-2a35de7d-0306-4281-90ba-b00c7a9ed82f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012277 Jul 25 16:18:14.497608 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1282 bytes} [Mon Jul 25 16:18:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:22:09.474565 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:09.476182 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Jul 25 16:22:09.476742 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:09.625836 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=6 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:09.842201 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-1670ff96-f0ac-46e8-9063-88401bd357d6 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:09.844937 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:22:09.844937 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 25 16:22:09.846322 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-1670ff96-f0ac-46e8-9063-88401bd357d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:09.846764 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-1670ff96-f0ac-46e8-9063-88401bd357d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:09.847555 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-1670ff96-f0ac-46e8-9063-88401bd357d6 admin admin] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:09.847974 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-1670ff96-f0ac-46e8-9063-88401bd357d6 admin admin] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:09.894766 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-1670ff96-f0ac-46e8-9063-88401bd357d6 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.269610 Jul 25 16:22:09.895968 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 25 16:22:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:22:10.790054 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:10.791112 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Jul 25 16:22:10.791568 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:10.995804 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-9f589b80-45bc-4e83-a979-62ada46df0d2 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:10.998380 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:22:10.998380 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 25 16:22:10.999726 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-9f589b80-45bc-4e83-a979-62ada46df0d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:11.000159 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-9f589b80-45bc-4e83-a979-62ada46df0d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:11.000941 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-9f589b80-45bc-4e83-a979-62ada46df0d2 admin admin] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:11.001398 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-9f589b80-45bc-4e83-a979-62ada46df0d2 admin admin] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:11.022560 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-9f589b80-45bc-4e83-a979-62ada46df0d2 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.087839 Jul 25 16:22:11.023154 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 37/72] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 25 16:22:10 2022] GET /compute/v2.1/os-services => generated 794 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:22:22.332256 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.333529 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001655 Jul 25 16:22:22.333955 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:22.484016 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell0:SELECT=4 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:22.485232 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell1:SELECT=4 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:22.486675 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=8 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:22:22.547475 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-a6401a7a-1312-4f03-84c9-bc86387f521f admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:22.550079 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:22:22.550079 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 25 16:22:22.551490 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-a6401a7a-1312-4f03-84c9-bc86387f521f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:22.551933 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-a6401a7a-1312-4f03-84c9-bc86387f521f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:22.552764 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-a6401a7a-1312-4f03-84c9-bc86387f521f admin admin] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:22.553185 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-a6401a7a-1312-4f03-84c9-bc86387f521f admin admin] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:22.580020 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-a6401a7a-1312-4f03-84c9-bc86387f521f admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.104204 Jul 25 16:22:22.580594 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 38/74] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 25 16:22:22 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:22:23.483597 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:23.484625 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3ed768f0-5895-4d09-854e-8e488930f590 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 25 16:22:23.485036 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Jul 25 16:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:22:23.691031 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-a8996e91-e796-496c-8a67-4edc0e26f462 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:22:23.693619 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 16:22:23.693619 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 25 16:22:23.695006 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-a8996e91-e796-496c-8a67-4edc0e26f462 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:23.695446 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-a8996e91-e796-496c-8a67-4edc0e26f462 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:23.696299 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-a8996e91-e796-496c-8a67-4edc0e26f462 admin admin] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:22:23.696749 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-a8996e91-e796-496c-8a67-4edc0e26f462 admin admin] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:22:23.720520 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-a8996e91-e796-496c-8a67-4edc0e26f462 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.091300 Jul 25 16:22:23.721457 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 39/76] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Jul 25 16:22:23 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:23:24.673105 dv-cinder-836973-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 16:23:24.674105 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: Mon Jul 25 16:23:24 2022 - graceful shutdown triggered... Jul 25 16:23:24.674558 dv-cinder-836973-15-iscsi devstack@n-api.service[103284]: Gracefully killing worker 1 (pid: 103284)... Jul 25 16:23:24.674938 dv-cinder-836973-15-iscsi devstack@n-api.service[103285]: Gracefully killing worker 2 (pid: 103285)... Jul 25 16:23:25.675279 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: worker 1 buried after 1 seconds Jul 25 16:23:25.675279 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: worker 2 buried after 1 seconds Jul 25 16:23:25.675279 dv-cinder-836973-15-iscsi devstack@n-api.service[103283]: goodbye to uWSGI. Jul 25 16:23:25.677165 dv-cinder-836973-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 16:23:25.678039 dv-cinder-836973-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 16:23:25.681614 dv-cinder-836973-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 16:23:25.695918 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 16:23:25 2022] *** Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: nodename: dv-cinder-836973-15-iscsi Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: machine: x86_64 Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: clock source: unix Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: pcre jit disabled Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: detected number of CPU cores: 4 Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: current working directory: / Jul 25 16:23:25.698930 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: detected binary path: /usr/bin/uwsgi-core Jul 25 16:23:25.700366 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: your processes number limit is 47680 Jul 25 16:23:25.700366 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: your memory page size is 4096 bytes Jul 25 16:23:25.700366 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: detected max file descriptor number: 2048 Jul 25 16:23:25.700366 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: lock engine: pthread robust mutexes Jul 25 16:23:25.700366 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: thunder lock: enabled Jul 25 16:23:25.700366 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 16:23:25.700366 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 16:23:25.768704 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: Python main interpreter initialized at 0x5609346159c0 Jul 25 16:23:25.768704 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: python threads support enabled Jul 25 16:23:25.768704 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: your server socket listen backlog is limited to 100 connections Jul 25 16:23:25.768704 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: your mercy for graceful operations on workers is 90 seconds Jul 25 16:23:25.769294 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 16:23:25.769575 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: *** Operational MODE: preforking *** Jul 25 16:23:25.770135 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: *** uWSGI is running in multiple interpreter mode *** Jul 25 16:23:25.770135 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: spawned uWSGI master process (pid: 117903) Jul 25 16:23:25.774703 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: spawned uWSGI worker 1 (pid: 117919, cores: 1) Jul 25 16:23:25.770403 dv-cinder-836973-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 16:23:25.776269 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: spawned uWSGI worker 2 (pid: 117920, cores: 1) Jul 25 16:23:25.776867 dv-cinder-836973-15-iscsi devstack@n-api.service[117903]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 16:23:26.489311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 16:23:26.533226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 16:23:27.695089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:23:27.695089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Jul 25 16:23:27.696027 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:23:27.696027 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: from cryptography.utils import int_from_bytes Jul 25 16:23:27.791757 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:23:27.791757 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: from cryptography.utils import int_from_bytes Jul 25 16:23:27.792790 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 16:23:27.792790 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: from cryptography.utils import int_from_bytes Jul 25 16:23:30.245557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 16:23:30.246438 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 16:23:30.246438 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 16:23:30.246742 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 16:23:30.247015 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 16:23:30.247411 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.247735 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.248070 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.248384 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.248714 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.249016 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.249375 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.249670 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.250006 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.250365 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.250574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.250910 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-15-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.251357 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.251728 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.252026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.252357 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.252659 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.252978 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.253271 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.253801 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.254305 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.254628 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.254947 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.255289 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.255791 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.256033 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.256433 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.256737 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.257021 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.257406 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.257768 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-15-iscsi {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.258089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.258396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.258709 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.259128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.259450 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.259741 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.260060 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.260450 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.260877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.261083 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.261568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.262317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.262317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.262570 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.262800 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.263107 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.263424 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.263725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.264204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.264385 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.264704 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.265128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.265509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.265813 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.266067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.266327 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.266648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.266965 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.267332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.267644 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.268207 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.268430 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.268738 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.269075 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.269364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.269677 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.270000 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.270310 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.270635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.270937 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.271253 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.271913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.272332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.272833 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.273382 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.273722 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.274006 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.274324 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.274676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.274985 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.275490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.276590 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.276590 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.276896 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.277006 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.277235 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.277569 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.277913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.278240 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.278543 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.278848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.279150 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.279445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.279753 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.280053 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.280354 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.280655 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.280957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.281255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.281589 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.281986 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.282293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.282618 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.282970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.283276 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.283588 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.283889 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.284190 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.284506 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.284812 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.285115 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.285467 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.285829 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.286075 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.286389 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.286691 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.286993 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.287306 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.287605 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.287911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.288216 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.288519 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.288850 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.289150 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.289506 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.289807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.290098 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.290554 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.291090 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.291391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.291697 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.292080 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.292409 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.292622 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.292920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.293240 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.293600 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.293933 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.294277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.294691 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.294919 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.295249 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.295564 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.299509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.299509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.299509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.299509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.299509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.299509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.300069 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.300404 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.300917 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.301562 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.302268 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.302723 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.303258 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.303809 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.304381 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.304922 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.305492 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.306073 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.306658 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.308506 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.309138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.309782 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.310323 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.310850 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.311374 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.311921 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.312465 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.312967 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.313509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.314071 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.314585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.315112 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.315711 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.316152 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.316719 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.317763 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.318299 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.318815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.319348 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.319869 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.320385 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.320937 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.321531 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.322076 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.322599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.323128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.323647 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.324187 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.324726 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.325185 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.325712 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.326222 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.326802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.327306 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.327823 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.328342 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.328876 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.329475 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.330059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.330617 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.331144 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.331720 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.332288 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.332922 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.333284 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.333837 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.334362 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.334895 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.335424 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.335961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.336529 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.337590 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.339155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.339975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.340544 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.341103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.341710 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.342262 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.343001 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.343577 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.344098 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.344621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.345144 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.345999 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.346786 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.347792 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.348186 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.348571 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.349404 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.350039 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.350455 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.350855 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.351231 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.351610 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.351982 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.352399 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.352773 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.353452 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.353864 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.354253 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.354654 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.355032 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.355413 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.355785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.356178 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.356922 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.357654 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.358055 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.358435 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.359277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.359512 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.360139 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.360538 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.360929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.366816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.366816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.366816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.366816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.366816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.366816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.366816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.366816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.368736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.368736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.368736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.368736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.369783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.369783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.370447 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.370829 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.371250 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.371634 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.372021 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.372397 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.372779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.373177 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.373691 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.374072 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.374629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.375017 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.375391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.375766 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.376138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.376539 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.376924 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.377459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.378109 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.378486 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.378926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.379677 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.380311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.380695 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.381066 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.381455 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.381836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.382250 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.382626 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.383012 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.383399 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.383860 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.384236 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.384779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.385198 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.385593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.386013 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.386382 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.386800 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.387328 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.387729 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.388364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.388754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.389200 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.389985 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.390618 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.390998 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.391401 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.391799 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.392317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.392701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.393078 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.393487 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.393910 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.394374 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.394872 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.395248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.395659 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.396032 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.396406 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.396828 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.397815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.398519 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.398971 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.399443 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.400191 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.400911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.401393 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.401772 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.402182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.402553 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.402928 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.403339 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.403730 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.404149 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.404583 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.405106 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.405498 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.405892 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.406261 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.406666 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.407059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.407404 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.407963 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.408583 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.408964 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.409495 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.409754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.410427 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.411037 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.411411 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.411794 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.412211 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.412561 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.412971 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.413390 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.413797 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.414163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.414616 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.415044 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.415396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.415765 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.416128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.416501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.416888 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.417259 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.417717 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.418184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.418803 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.419182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.419550 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.419920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.420564 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.421223 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.421617 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.421973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.422344 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.422742 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.423199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.423625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.424010 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.424380 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.424845 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.425236 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.425599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.425964 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.426335 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.426703 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.427081 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.427480 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.427988 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.428374 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.428983 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.429398 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.429753 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.430122 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.430814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.431729 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.431879 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.432199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.432576 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.432943 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.433363 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.433732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.434101 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.434468 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.434920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.435411 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.435634 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.435996 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.436387 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.436762 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.437838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.437838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.437838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.438475 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.439073 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.439505 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.439876 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.440255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.440909 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.441565 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.442025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.442318 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.442688 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.443069 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.443444 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.443818 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.444228 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.444597 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.445075 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.448849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.448849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.448849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.448849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.448849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.448849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.448849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.448849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.451084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.451084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.451084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.451084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.451084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.451084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.451084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.453623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.453623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.453623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.453623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.453623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.453623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.454195 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.454417 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.454722 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.455037 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.455447 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.455753 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.456199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.456343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 16:23:30.456768 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.456856 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 16:23:30.456938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.457105 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.457188 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 16:23:30.457580 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.457770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 16:23:30.457770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 16:23:30.458133 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.458275 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.458477 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.458757 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.458906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.459105 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.459440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.459582 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.459754 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.459977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.460177 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.460389 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.460621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.460760 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.460973 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.461128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.461290 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.461659 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-15-iscsi {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.462127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.462298 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.462428 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.462565 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.462703 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.462878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.463010 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.463178 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.463345 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.463503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.463772 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.463916 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.464215 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.464354 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.464693 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.464848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.464978 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.465127 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.465299 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.465555 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.465838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.466028 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.466168 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.466321 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.466483 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.466741 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.466889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.467108 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.467237 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.467419 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.467785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.467929 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-15-iscsi {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.474718 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.474940 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.475086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.475372 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.475531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.475769 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.475915 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.475915 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.476231 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.476362 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.476500 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.476629 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.476765 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.476900 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.477034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.477169 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.477412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.477412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.477669 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.477669 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.477669 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.478066 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.478204 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.478334 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.478334 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.478592 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.478719 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.478846 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.478981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.479115 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.479249 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.479396 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.479591 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.479745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.479745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.480004 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.480144 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.480277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.480405 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.480544 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.480685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.480821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.480955 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.480955 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.480955 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.480955 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.481481 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.481648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.481838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.481983 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.481983 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.482254 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.482595 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.482777 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.482919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.482919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.483177 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.483305 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.483305 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.483305 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.483698 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.483855 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.483855 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.484114 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.484242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.484242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.484498 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.484644 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.484780 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.484908 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.485041 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.485168 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.485168 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.485168 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.485168 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.486030 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.486198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.486412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.486602 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.486602 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.486930 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.487065 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.487065 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.487311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.487438 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.487601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.487734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.487734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.487982 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.488116 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.488258 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.488395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.488395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.488395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.488756 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.488885 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.489026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.489162 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.489162 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.489444 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.489573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.489573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.489839 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.489975 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.489975 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.490234 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.490369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.490369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.490622 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.490758 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.490758 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.490997 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.491134 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.491134 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.491389 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.491820 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.491965 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.492101 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.492101 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.492364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.492504 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.492504 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.492876 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.493010 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.493136 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.493397 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.493556 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.493778 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.493921 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.494093 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.494301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.494440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.494901 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.495052 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.495200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.495336 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.495466 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.495685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.496062 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.496288 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.496459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.496588 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.496798 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.496928 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.496928 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.497187 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.497317 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.497548 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.497692 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.497881 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.498053 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.498197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.498481 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.498674 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.498814 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.499032 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.499174 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.499370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.499705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.500018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.500018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.500263 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.500520 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.500693 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.500863 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.501003 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.501218 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.501456 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.501781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.501917 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.502161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.502473 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 16:23:30.502860 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.503033 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.503296 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.503437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.503670 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.503808 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.503989 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.504161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.504333 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.504604 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.504745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.505051 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.505187 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.505356 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.505639 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.505771 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.506115 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.506257 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.506413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.506959 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.507110 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.507249 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.507408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.507648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.507789 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.508091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.508231 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.508440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.508584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.508775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.509033 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.509165 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.509451 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.509737 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.509898 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.510126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.510435 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.510567 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.510780 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.511093 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.511236 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.511500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.511670 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.511932 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.512251 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.512497 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.512686 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.513044 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.513207 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.513489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.513725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.513865 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.514052 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.514201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.514467 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.514725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.514886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.515326 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.515541 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.515768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.515925 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.516073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.516220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.516521 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.516721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.516874 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.517054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.517270 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.517569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.518038 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.518322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.518495 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.518639 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.518935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.519074 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.519296 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.519603 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.519805 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.519948 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.520327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.520477 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.520735 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.520875 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.521012 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.521140 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.521359 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.521507 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.521780 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.522022 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.522166 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.522503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.522641 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.522770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.523399 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.523592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.523787 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.523787 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.524045 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.524187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.524330 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.524469 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.524597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.524730 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.524866 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.525162 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.525308 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.525637 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.525917 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.526048 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.526315 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.526627 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.526869 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.527153 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.527352 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.527515 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.527719 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.527912 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.528098 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.528346 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.528544 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.528684 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.528956 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.529104 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.529259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.529579 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.529999 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.530178 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.530370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.530370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.530811 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.531009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.531009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.531332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.531475 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.531660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.531819 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.532095 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.532252 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.532382 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.532582 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.532859 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.533028 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.533280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.533781 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.533982 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.534139 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.534269 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.534395 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.534521 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.534521 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.534769 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.534906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.535074 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.535206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.535375 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.535564 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.535823 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.535988 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.536119 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.536296 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.536493 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.536648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.536895 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.537259 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.537438 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.537578 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.537705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.537841 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.538099 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.538233 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.538513 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.538642 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.538839 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.538986 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.539165 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.539412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.539550 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.539782 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.539936 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.540259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.541122 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.541122 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.541418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.541573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.541573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.541831 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.541967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.542094 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.542269 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.542269 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.542562 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.542724 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.543012 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.543142 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.543281 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.543510 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.543936 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.544100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.544283 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.544425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.544568 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.544706 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.544844 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.545142 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.545304 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.545519 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.545664 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.545818 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.546063 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.546204 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.546341 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.546484 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.546620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.546942 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.547089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.547258 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.547548 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.547698 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.547938 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.548072 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.548250 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.548468 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.548612 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.548912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.549229 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.549423 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.549668 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.549934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.550272 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.550424 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.550610 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.550925 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.551248 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.551576 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.551724 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.551885 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.552194 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.552373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.552537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.552692 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.552857 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.553185 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.553484 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.553618 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.553831 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.554251 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.554428 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.554606 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.554766 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.554924 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.555112 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.555112 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.555390 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.555519 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.555646 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.555798 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.555933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.556197 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.556337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.556543 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.556686 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.556867 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.557056 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.557264 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.557526 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.557804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.557934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.558074 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.558219 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.558441 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.558626 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.558760 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.559046 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.559186 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.559358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.559505 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.559665 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.559927 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.560068 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.560428 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.560584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.560714 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.560850 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.560986 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.561323 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.561487 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.561630 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.561914 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.562064 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.562201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.562328 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.562505 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.562727 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.562936 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.563124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.563425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.563558 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.563685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.563788 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.564082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.564478 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.564644 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.564815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.564972 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.565067 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.565269 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.565402 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.565611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.565727 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.565930 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.566024 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.566350 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.566457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.566544 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.566717 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.566842 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.566942 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.567157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.567540 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.567897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.568189 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.568293 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.568379 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.568471 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.568556 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.568743 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.568837 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.569069 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.569170 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.569419 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.569530 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.569758 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.569863 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.570103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.570201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.570475 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.570616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.570754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.570858 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.571087 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.571404 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.571607 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.571791 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.571956 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.572114 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.572280 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.572456 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.572619 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.572794 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.572964 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.573120 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.573271 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.573471 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.573606 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.573758 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.573912 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.574049 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.574207 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.574356 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.574496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.574635 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.574767 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.574909 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.575067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.575206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.575351 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.575487 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.575616 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.575779 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.575931 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.576072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.576210 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.576349 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.576486 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.576635 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.576788 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.576921 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.577067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.577202 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.577486 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.577656 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.577799 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.578026 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.578211 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.578369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.578514 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.578682 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.578834 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.580168 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.580332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.580501 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.580671 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.580932 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.581092 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.581262 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.581502 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.581706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.581882 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.582031 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.582181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.582429 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.582630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.582838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.583048 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.583239 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.583431 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.583614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.583823 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.584030 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.584208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.584362 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.584515 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.584726 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.584927 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.585108 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.585273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.585465 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.585633 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.585794 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.585942 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.586111 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.586261 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.586425 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.586580 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.586794 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.586952 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.587125 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.587281 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.587421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.587558 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.587721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.587872 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.588082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.588082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.588379 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.588533 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.588683 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.588851 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.588995 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.589241 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.589435 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.589599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.589819 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.589984 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.590126 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.590283 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.590427 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.590562 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.590724 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.590950 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.591090 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.591241 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.591374 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.591521 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.591917 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.591917 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.592205 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.592353 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.592501 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.592625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.592765 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.592894 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.593036 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.593182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.593182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.593182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.593654 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.593884 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.594098 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.594309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.594309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.594711 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.594943 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.595181 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.595486 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.595695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.595904 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.596119 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.596353 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.596551 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.596752 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.596950 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.596950 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.596950 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.597694 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.597866 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.597866 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.598211 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.598349 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.598628 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.598797 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.598797 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.599197 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.599386 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.599552 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.599720 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.599720 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.600052 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.601206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.601400 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.601555 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.601736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.602043 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.602043 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.602628 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.602895 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.603093 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.603245 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.603412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.603554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.603554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.603831 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.604037 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.604253 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.604412 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.604582 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.604749 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.604899 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.605072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.605238 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.605437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.605605 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.605771 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.605935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.606103 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.606103 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.606408 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.606408 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.606689 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.606856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.607004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.607225 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.607437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.607652 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.607868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.608044 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.608227 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.608393 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.608547 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.608714 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.608880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.609052 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.609220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.609490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.609640 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.609806 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.609967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.610126 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.610281 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.610439 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.610591 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.610740 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.610940 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.611110 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.611272 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.611497 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.611656 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.611825 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.612004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.612175 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.612348 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.612691 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.612863 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.613020 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.613191 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.613378 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.613602 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.613772 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.613937 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.614103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.614241 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.614392 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.614538 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.614705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.614922 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.615103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.615257 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.615422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.615597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.615756 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.615912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.616077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.616241 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.616388 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.616858 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.617022 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.617185 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.617473 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.617635 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.617851 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.618061 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.618227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.618408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.618567 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.618734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.618903 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 16:23:30.619073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.619073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.619073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.619073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.619073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.619073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.619073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.619073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.620161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.620161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.620161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.620161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.620161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.620161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.620161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.620161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.621274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.621274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.621274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.621274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.621274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.621274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.621274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.621274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.622532 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.622532 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.622532 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.622532 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.622532 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.622532 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.623376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.623376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.623376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.623904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.624085 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.624367 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.624690 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.625046 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.625480 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.625711 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.626146 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.626486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.626864 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.627195 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.627550 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.627861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.628170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.628487 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.628796 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.629105 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.629457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.629769 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.630081 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.630397 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.630704 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.631015 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.631321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.631647 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.632091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.632419 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.632741 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.633067 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.633454 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.633721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.634068 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.634385 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.634690 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.634997 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.635303 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.635665 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.635972 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.636292 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.636628 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.636959 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.637270 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.637763 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.638091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.638401 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.638722 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.639052 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.639597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.639766 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.639952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.640297 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.640579 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.640891 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.641207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.641544 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.641852 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.642307 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.642516 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.642808 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.643134 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.643446 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.643756 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.644070 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.644378 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.644733 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.645072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.645435 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.645718 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.646044 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.646376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.646689 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.647018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.647333 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.647657 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.647973 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.648312 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.648606 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.648927 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.649256 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.649592 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.649916 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.650236 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.650555 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.651146 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.651470 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.651786 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.652101 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.652438 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.652734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.653047 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.653442 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.653709 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.654026 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.654348 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.654687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.655021 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.655350 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.655692 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.656014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.656333 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.656652 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.656968 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.657350 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.657672 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.658042 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.658399 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.658732 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.659390 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.662302 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.662644 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.662996 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.663470 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.663668 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.663985 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.664417 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.664652 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.665505 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.665505 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.665831 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.666026 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.666370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.666725 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.667317 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.667665 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.668013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.668347 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.668676 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.669004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.669450 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.669885 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.670363 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.670892 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.671231 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.671571 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.671891 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.672228 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.672564 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.672861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.673187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.673661 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.674330 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.674706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.675072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.675524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.675877 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.676201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.676481 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.676859 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.677172 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.677511 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.677813 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.678197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.678509 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.678818 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.679147 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.679577 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.679972 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.680339 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.680604 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.680982 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.681309 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.681689 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.682074 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.682318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.682614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.682916 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.683229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.683543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.683985 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.684277 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.684611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.684964 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.685502 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.685673 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.685990 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.686333 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.686690 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.687016 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.687352 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.687708 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.688063 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.688392 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.688714 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.689264 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.689543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.689899 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.690573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.690920 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.691250 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.691621 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.691964 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.692265 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.692580 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.692889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.693266 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.693629 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.693946 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.694335 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.694580 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.694901 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.695215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.695544 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.695819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.696159 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.696478 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.696825 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.697145 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.697443 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Registered counter for database nova_api Jul 25 16:23:30.697554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.697828 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.698358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.698555 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.698904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.699211 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.699553 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.699885 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.700234 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.700558 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.700879 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.701239 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.701622 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.701941 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.702261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.702702 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.703041 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.703397 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.703712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.704139 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.704385 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.704760 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.705082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.705443 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.705778 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.706118 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.706630 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.706868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.707194 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.707530 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.707823 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.713200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.713200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.713200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.713200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.713200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.713200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.713200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.713200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.714311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.714311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.714311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.714311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.714311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.714311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.714311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.714311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.715784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.715784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.715784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.715784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.715784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.715784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.715784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.715784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.717097 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.717097 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.717097 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.717097 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.717097 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.717097 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.720415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.720415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.720415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.720415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.720415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.720415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.720415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.720415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.721729 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.721729 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.721729 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.722205 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.722205 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.722522 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.722840 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.723324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.723612 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.724682 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.724682 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.724682 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.725219 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.725615 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.725946 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.726265 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.726590 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.726914 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.727518 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.727978 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.728345 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.728675 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.729005 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.729371 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.729708 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.730030 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.730455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.730953 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.731328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.731679 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.731858 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:23:30.732034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.732493 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.732839 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.733418 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.733962 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 16:23:30.734413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 16:23:30.743207 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:23:30.851427 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.context [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3(cell1) {{(pid=117920) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 16:23:30.859423 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:30.862721 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:30.866204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:30.868584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:30.872724 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Registered counter for database nova_cell0 Jul 25 16:23:30.880933 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Registered counter for database nova_cell1 Jul 25 16:23:30.892012 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:23:30.895243 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:23:30.902320 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Registered counter for database nova_api Jul 25 16:23:30.906197 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:23:30.908478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:23:30.923812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:23:30.931440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:23:30.994764 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.context [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3(cell1) {{(pid=117919) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 16:23:31.000939 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.003143 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.004156 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:23:31.006881 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:23:31.009953 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Registered counter for database nova_cell0 Jul 25 16:23:31.015880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Registered counter for database nova_cell1 Jul 25 16:23:31.030314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:23:31.031779 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:23:31.041008 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:23:31.043586 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:23:31.195400 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO dbcounter [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Registered counter for database nova_cell0 Jul 25 16:23:31.206632 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_db.sqlalchemy.engines [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:23:31.207234 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO dbcounter [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Registered counter for database nova_cell0 Jul 25 16:23:31.215307 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writer thread running {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:23:31.215898 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_db.sqlalchemy.engines [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 16:23:31.221930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writer thread running {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 16:23:31.558376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:23:31.568273 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:23:31.838916 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:23:31.853938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:23:31.933580 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:23:31.940753 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: WARNING keystonemiddleware.auth_token [None req-4f24f234-cdf5-4127-92d4-38b8fbe4836f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:23:31.945985 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5609346159c0 pid: 117919 (default app) Jul 25 16:23:32.425045 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 16:23:32.431856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: WARNING keystonemiddleware.auth_token [None req-fbfe6319-98a1-41be-852e-1fbf3fbcf96b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 16:23:32.438068 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5609346159c0 pid: 117920 (default app) Jul 25 16:24:20.665327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:20.667656 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:20.668491 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:20.669592 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:21.178235 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1f266e83-217f-40ab-abe4-92ece66bde5b tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f44110b2f70>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:21.630335 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:21.633146 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:21.637617 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:21.639007 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:23.491751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75b71187-198c-4a5a-87e1-2a4c76c72b8a tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Action: 'create', calling method: .version_select at 0x7f441104a4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1608068789", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:23.581087 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1f266e83-217f-40ab-abe4-92ece66bde5b tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/1da2aeba-a455-4932-91e2-1c6b07bf593f" status: 200 len: 350 microversion: 2.1 time: 2.934483 Jul 25 16:24:23.586321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 1/1] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:20 2022] GET /compute/v2.1/os-volumes/1da2aeba-a455-4932-91e2-1c6b07bf593f => generated 350 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:24.270369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4972da16-03b3-4262-8877-4ea0cbd1fd3e tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Action: 'create', calling method: .version_select at 0x7f4410eb4280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1123142132"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:26.238118 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4972da16-03b3-4262-8877-4ea0cbd1fd3e tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.649062 Jul 25 16:24:26.239506 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 2/2] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Jul 25 16:24:23 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2652 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 16:24:26.275066 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-96ec9c6c-cefc-439a-acb3-b6b9bcbd9179 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e61160>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:26.447892 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-75b71187-198c-4a5a-87e1-2a4c76c72b8a tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.823853 Jul 25 16:24:26.453506 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1156 bytes} [Mon Jul 25 16:24:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4848 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 16:24:26.507087 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe773570-114e-4eec-ac03-8b0ab457202b tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f4410e9b3a0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:26.515864 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-96ec9c6c-cefc-439a-acb3-b6b9bcbd9179 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7" status: 200 len: 346 microversion: 2.1 time: 0.256069 Jul 25 16:24:26.516831 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:26 2022] GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 => generated 346 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:26.549615 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a60e9a42-7b8e-4efb-9f56-3f3cbd1c57dc tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Calling method '.version_select at 0x7f4410e61820>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:26.798742 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe773570-114e-4eec-ac03-8b0ab457202b tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/c5cd6df0-0640-4519-82bb-2a3e641264d8" status: 200 len: 351 microversion: 2.1 time: 0.342700 Jul 25 16:24:26.812768 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 2/5] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:26 2022] GET /compute/v2.1/os-volumes/c5cd6df0-0640-4519-82bb-2a3e641264d8 => generated 351 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:26.844340 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3ce80408-e987-4b23-b206-7d8f66d31abf tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Action: 'create', calling method: .version_select at 0x7f4410e9ba60>, body: {"snapshot": {"volume_id": "20c33c32-b4fe-44f3-82e7-f413df7acbb7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1986080391"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:27.906818 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a60e9a42-7b8e-4efb-9f56-3f3cbd1c57dc tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375" status: 200 len: 354 microversion: 2.1 time: 1.377804 Jul 25 16:24:27.910254 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 4/6] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:26 2022] GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375 => generated 354 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:27.933377 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8b86245d-49ba-47ab-9583-1906db406b68 tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Calling method '.version_select at 0x7f441182c0d0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:28.445881 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3ce80408-e987-4b23-b206-7d8f66d31abf tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.630981 Jul 25 16:24:28.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 3/7] 10.222.0.66 () {60 vars in 1162 bytes} [Mon Jul 25 16:24:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:28.488219 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6158b5c-c608-4c93-ac4d-e7480d576587 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410eb1b80>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:28.675754 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8b86245d-49ba-47ab-9583-1906db406b68 tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375" status: 200 len: 354 microversion: 2.1 time: 0.750390 Jul 25 16:24:28.680726 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b6158b5c-c608-4c93-ac4d-e7480d576587 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6" status: 200 len: 287 microversion: 2.1 time: 0.202775 Jul 25 16:24:28.681872 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1251 bytes} [Mon Jul 25 16:24:28 2022] GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 => generated 287 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:28.691821 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 5/9] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:27 2022] GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375 => generated 354 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:28.698209 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-860c5a1a-470e-4482-aa6b-22cceb346e46 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e615e0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:28.715476 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fde71a72-b4ca-41e6-b270-98744b325d6d tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Calling method '.version_select at 0x7f4410e9be50>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:28.849065 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-860c5a1a-470e-4482-aa6b-22cceb346e46 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.155663 Jul 25 16:24:28.850542 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 6/10] 10.222.0.66 () {58 vars in 1140 bytes} [Mon Jul 25 16:24:28 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:28.866522 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7ede8707-80b9-494f-9d67-912ce1a46522 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e648b0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:29.062554 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fde71a72-b4ca-41e6-b270-98744b325d6d tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375" status: 202 len: 0 microversion: 2.1 time: 0.367469 Jul 25 16:24:29.063660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 5/11] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:24:28 2022] DELETE /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:24:29.075093 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2f7b67a2-67d9-4b44-a845-4bae8186f602 tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Calling method '.version_select at 0x7f4410e9b4c0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:29.254210 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7ede8707-80b9-494f-9d67-912ce1a46522 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6" status: 200 len: 287 microversion: 2.1 time: 0.394198 Jul 25 16:24:29.254856 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 7/12] 10.222.0.66 () {58 vars in 1251 bytes} [Mon Jul 25 16:24:28 2022] GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 => generated 287 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:29.392307 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f7b67a2-67d9-4b44-a845-4bae8186f602 tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375" status: 200 len: 353 microversion: 2.1 time: 0.322396 Jul 25 16:24:29.393871 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 6/13] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:29 2022] GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375 => generated 353 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:29.845963 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d5fbd08d-ea6d-4407-a915-723420e2ceb1 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f4410e61c10>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:29.941038 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d5fbd08d-ea6d-4407-a915-723420e2ceb1 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d42b1eca-5b4e-44d2-971f-d3530641c55b" status: 200 len: 350 microversion: 2.1 time: 0.100872 Jul 25 16:24:29.942134 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 8/14] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:29 2022] GET /compute/v2.1/os-volumes/d42b1eca-5b4e-44d2-971f-d3530641c55b => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:29.957756 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-46eba84e-be9b-4248-98f1-0ddf1e0ce414 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f4410e615e0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:30.026207 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-26846715", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "networks": [{"uuid": "54e60efa-4def-4721-894e-aa1775d3a3a6"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:30.241704 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-46eba84e-be9b-4248-98f1-0ddf1e0ce414 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.283220 Jul 25 16:24:30.241704 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 9/15] 10.222.0.66 () {58 vars in 1134 bytes} [Mon Jul 25 16:24:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:30.262759 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e7aaeffc-39ba-4181-85e4-ee625dceef9d tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f4410e64430>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:30.370997 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] validate_networks() for [('54e60efa-4def-4721-894e-aa1775d3a3a6', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:24:30.523732 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e7aaeffc-39ba-4181-85e4-ee625dceef9d tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.271283 Jul 25 16:24:30.525180 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 10/16] 10.222.0.66 () {58 vars in 1149 bytes} [Mon Jul 25 16:24:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:30.547500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5f319dec-387a-46ad-9a52-7fdc7b97451a tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e643a0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:30.642871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5f319dec-387a-46ad-9a52-7fdc7b97451a tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6" status: 200 len: 287 microversion: 2.1 time: 0.114430 Jul 25 16:24:30.644103 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 11/17] 10.222.0.66 () {58 vars in 1251 bytes} [Mon Jul 25 16:24:30 2022] GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 => generated 287 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:30.652713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ed13e59-4284-48b6-844e-f93d7eaf74d5 tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Calling method '.version_select at 0x7f4410e64550>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:30.749381 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2ed13e59-4284-48b6-844e-f93d7eaf74d5 tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375" status: 200 len: 353 microversion: 2.1 time: 0.103616 Jul 25 16:24:30.750639 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 12/18] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:30 2022] GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:30.763075 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f202677b-66b9-4767-b06b-b8154eee8dbb tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f4410eb43a0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:30.901034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f202677b-66b9-4767-b06b-b8154eee8dbb tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.148237 Jul 25 16:24:30.902611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 13/19] 10.222.0.66 () {58 vars in 1134 bytes} [Mon Jul 25 16:24:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:30.929619 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9312c3b7-4177-4829-9a5a-59f8ccac8b88 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f441182c5e0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:31.072013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9312c3b7-4177-4829-9a5a-59f8ccac8b88 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.152686 Jul 25 16:24:31.072596 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 14/20] 10.222.0.66 () {58 vars in 1167 bytes} [Mon Jul 25 16:24:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:31.099922 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3f84600d-40be-4068-b471-57717686d2eb tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f4410e610d0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:31.375919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3f84600d-40be-4068-b471-57717686d2eb tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.289680 Jul 25 16:24:31.376986 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 15/21] 10.222.0.66 () {58 vars in 1170 bytes} [Mon Jul 25 16:24:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:31.396009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d75b5750-6fc0-4cca-b031-62a7042942d2 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f4410e7a5e0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:31.705817 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d75b5750-6fc0-4cca-b031-62a7042942d2 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.316725 Jul 25 16:24:31.729521 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 16/22] 10.222.0.66 () {58 vars in 1155 bytes} [Mon Jul 25 16:24:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:31.788550 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-825fe277-2bd8-4f31-8ec3-8aca1b0a3415 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e614c0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:31.941279 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-825fe277-2bd8-4f31-8ec3-8aca1b0a3415 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6" status: 200 len: 287 microversion: 2.1 time: 0.208279 Jul 25 16:24:31.968710 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 17/23] 10.222.0.66 () {58 vars in 1251 bytes} [Mon Jul 25 16:24:31 2022] GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 => generated 287 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:31.988898 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-57657413-f637-4bd2-8c15-ec703a7a5d78 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f4410e64160>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:32.257032 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-57657413-f637-4bd2-8c15-ec703a7a5d78 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.285974 Jul 25 16:24:32.269458 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 18/24] 10.222.0.66 () {58 vars in 1188 bytes} [Mon Jul 25 16:24:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:32.275952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d8083d1a-d9fe-4477-bdfa-bea5c11945fd tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Calling method '.version_select at 0x7f4410e7a670>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:32.373457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d8083d1a-d9fe-4477-bdfa-bea5c11945fd tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375" status: 200 len: 353 microversion: 2.1 time: 0.102255 Jul 25 16:24:32.374475 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 19/25] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:32 2022] GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:32.380446 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c4adbfac-a2b6-4567-a755-4bc0fba24726 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] Calling method '.version_select at 0x7f441182c5e0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:32.685099 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c4adbfac-a2b6-4567-a755-4bc0fba24726 tempest-VolumesTestJSON-1054913179 tempest-VolumesTestJSON-1054913179-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.308494 Jul 25 16:24:32.685884 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 20/26] 10.222.0.66 () {58 vars in 1155 bytes} [Mon Jul 25 16:24:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:32.969571 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a7cd26d9-97bc-4bfc-9e73-da2d0eaf09f8 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e610d0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:33.131653 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a7cd26d9-97bc-4bfc-9e73-da2d0eaf09f8 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6" status: 200 len: 288 microversion: 2.1 time: 0.172318 Jul 25 16:24:33.132280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 21/27] 10.222.0.66 () {58 vars in 1251 bytes} [Mon Jul 25 16:24:32 2022] GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 => generated 288 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:33.150135 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-da31f7ef-15ea-4ba2-aebc-9224926aa786 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e61940>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:33.379540 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:24:33.380629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:24:33.381790 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:24:33.382725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:24:33.383867 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:24:33.416236 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-da31f7ef-15ea-4ba2-aebc-9224926aa786 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6" status: 202 len: 0 microversion: 2.1 time: 0.274285 Jul 25 16:24:33.417655 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 22/28] 10.222.0.66 () {58 vars in 1254 bytes} [Mon Jul 25 16:24:33 2022] DELETE /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:24:33.427112 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-62fa74f5-b013-46c4-b4e6-144f497a0aae tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Calling method '.version_select at 0x7f4410e615e0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:33.484972 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:33.498959 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:33.500624 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:33.501447 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:33.644609 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-62fa74f5-b013-46c4-b4e6-144f497a0aae tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] HTTP exception thrown: Volume 6ed5a3d7-556e-4392-bcc1-d2a052ae9375 could not be found. Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-62fa74f5-b013-46c4-b4e6-144f497a0aae tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Request method failure captured: Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375 HTTP/1.1 Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sO1WsQ5rXWBXLbZXS6S2fK09YC2aGmXSZoqF95Gu00TdeGUPHO-uimxMYwSCUEvGpjedwhqE8fZwnBw9laB909XhOhzTykD7BU8qPMd8jIrY5Oca8g1WyLucSDLDTo9xY_fMtHeSAIX0l3OBpctpBJyj-_ACUJ17yKrTnwjZMm-exs Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: f57d34a39f87447f82b90b67a29cf2c8 Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesGetTestJSON-1190825642 Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:24:33.663076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f57d34a39f87447f82b90b67a29cf2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f57d34a39f87447f82b90b67a29cf2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f57d34a39f87447f82b90b67a29cf2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f57d34a39f87447f82b90b67a29cf2c8"}]}] Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesGetTestJSON-1190825642 Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: f57d34a39f87447f82b90b67a29cf2c8 Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesGetTestJSON-1190825642 Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesGetTestJSON-1190825642-project Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 3a30c39e01734a7c8630e9ed28cbf510 Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesGetTestJSON-1190825642-project Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Volume 6ed5a3d7-556e-4392-bcc1-d2a052ae9375 could not be found. Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '6ed5a3d7-556e-4392-bcc1-d2a052ae9375'} Jul 25 16:24:33.665531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ed5a3d7-556e-4392-bcc1-d2a052ae9375 could not be found. (HTTP 404) (Request-ID: req-063a8c2e-6c6c-4581-931f-aeb7d7af6144) Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:33.668179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:24:33.670559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ed5a3d7-556e-4392-bcc1-d2a052ae9375 could not be found. Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 16:24:33.672713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ed5a3d7-556e-4392-bcc1-d2a052ae9375 could not be found. Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ed5a3d7-556e-4392-bcc1-d2a052ae9375 could not be found. Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-62fa74f5-b013-46c4-b4e6-144f497a0aae tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] Returning 404 to user: Volume 6ed5a3d7-556e-4392-bcc1-d2a052ae9375 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:33.677078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-62fa74f5-b013-46c4-b4e6-144f497a0aae tempest-VolumesGetTestJSON-1190825642 tempest-VolumesGetTestJSON-1190825642-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375" status: 404 len: 109 microversion: 2.1 time: 0.248099 Jul 25 16:24:33.684662 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 23/29] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:33 2022] GET /compute/v2.1/os-volumes/6ed5a3d7-556e-4392-bcc1-d2a052ae9375 => generated 109 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:24:33.717684 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c8b1efb6-0515-44be-a3be-6b1a3e0ea0ae tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410eb41f0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:33.774341 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Getting quotas for project 287b6d7980174314b20fe6b172725bf4. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:33.799570 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Getting quotas for user f2d0f7e3f1cc4955a0ca99d588344322 and project 287b6d7980174314b20fe6b172725bf4. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:33.845237 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:24:33.863515 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:24:34.012195 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-c8b1efb6-0515-44be-a3be-6b1a3e0ea0ae tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] HTTP exception thrown: Snapshot f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 could not be found. Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c8b1efb6-0515-44be-a3be-6b1a3e0ea0ae tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Request method failure captured: Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 HTTP/1.1 Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sO1GPsmCJOcxkmD81Y87OvGFMXnFiPnFoNhOmlB3uB9clCh9daBa50LIiEiiTFAFRj5uPaIE6EKqu9ioN0VIyz6h5lKC3T1Vo5NYlvUwmjKiVO_sgBC-Uak542-XtGZ3WqXabWlBAEfqeMg5PVgkLX-2OdJj6z3NP5T4DwG-sXzvak Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 0ab28729cacc4da1a5025f52ac5f1127 Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:24:34.018343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ab28729cacc4da1a5025f52ac5f1127"}]}] Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 0ab28729cacc4da1a5025f52ac5f1127 Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotsTestJSON-2126543939-project Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: ed49dd65d33b408a8d4850c30e4e8a25 Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2126543939-project Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Snapshot f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 could not be found. Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6'} Jul 25 16:24:34.020721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 could not be found. (HTTP 404) (Request-ID: req-97461417-379b-463e-9235-ec9e6a48a0ed) Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:34.022100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:24:34.023699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 could not be found. Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 16:24:34.025566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 could not be found. Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 could not be found. Jul 25 16:24:34.027620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:34.032542 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c8b1efb6-0515-44be-a3be-6b1a3e0ea0ae tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Returning 404 to user: Snapshot f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:34.045893 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c8b1efb6-0515-44be-a3be-6b1a3e0ea0ae tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6" status: 404 len: 111 microversion: 2.1 time: 0.353888 Jul 25 16:24:34.048830 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 24/30] 10.222.0.66 () {58 vars in 1251 bytes} [Mon Jul 25 16:24:33 2022] GET /compute/v2.1/os-snapshots/f8d1ccc0-55b8-4452-af8c-5c8c4a4c07a6 => generated 111 bytes in 364 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:24:34.098929 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-11b9de13-e4e2-432a-b33b-b1b52a847974 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e615e0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:34.142621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-28eb9585-9215-4f8c-8bc0-a8ede01a7799 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.213554 Jul 25 16:24:34.145592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 7/31] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 4217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:24:34.177749 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3e1b4a1d-6a4c-4fbf-8e23-28a4be6c60ab tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:34.180196 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3e1b4a1d-6a4c-4fbf-8e23-28a4be6c60ab tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:34.545872 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-11b9de13-e4e2-432a-b33b-b1b52a847974 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7" status: 202 len: 0 microversion: 2.1 time: 0.487962 Jul 25 16:24:34.546756 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 25/32] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:24:34 2022] DELETE /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:24:34.557607 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-907c76a0-3e04-4f74-8b8c-b2f800da6ed6 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e61940>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:34.767702 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-907c76a0-3e04-4f74-8b8c-b2f800da6ed6 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7" status: 200 len: 345 microversion: 2.1 time: 0.213550 Jul 25 16:24:34.770178 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 26/33] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:34 2022] GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 => generated 345 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:34.911675 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3e1b4a1d-6a4c-4fbf-8e23-28a4be6c60ab tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:34.962194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3e1b4a1d-6a4c-4fbf-8e23-28a4be6c60ab tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1213 microversion: 2.1 time: 0.799358 Jul 25 16:24:34.962820 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 8/34] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:34 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1213 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:35.797236 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7229290c-50ee-4bc0-9ad0-bec489680159 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410e61550>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:35.997323 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7fc7261-5499-4a83-9565-3f6c97c137b3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:36.000520 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a7fc7261-5499-4a83-9565-3f6c97c137b3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:36.052634 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7229290c-50ee-4bc0-9ad0-bec489680159 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7" status: 200 len: 345 microversion: 2.1 time: 0.262824 Jul 25 16:24:36.065458 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 27/35] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:35 2022] GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 => generated 345 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:36.469527 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a7fc7261-5499-4a83-9565-3f6c97c137b3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:36.484783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a7fc7261-5499-4a83-9565-3f6c97c137b3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1213 microversion: 2.1 time: 0.491597 Jul 25 16:24:36.486457 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 9/36] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:35 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1213 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:37.077840 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f75193a1-2069-4f25-9621-8b1eb8cbe0fb tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410eb4550>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:37.307645 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f75193a1-2069-4f25-9621-8b1eb8cbe0fb tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7" status: 200 len: 345 microversion: 2.1 time: 0.232174 Jul 25 16:24:37.311973 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 28/37] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:37 2022] GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 => generated 345 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:37.528544 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0d3ce730-a114-43a3-85ba-cedb441761cf tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:37.533471 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0d3ce730-a114-43a3-85ba-cedb441761cf tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:37.907904 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0d3ce730-a114-43a3-85ba-cedb441761cf tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:37.933888 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0d3ce730-a114-43a3-85ba-cedb441761cf tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1213 microversion: 2.1 time: 0.413291 Jul 25 16:24:37.941779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 10/38] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:37 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1213 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:38.329921 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eb97b29a-de89-43a3-a0ed-a4cb6b7ef451 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410eb4f70>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:38.566692 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-eb97b29a-de89-43a3-a0ed-a4cb6b7ef451 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] HTTP exception thrown: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eb97b29a-de89-43a3-a0ed-a4cb6b7ef451 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Request method failure captured: Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 HTTP/1.1 Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sO1GPsmCJOcxkmD81Y87OvGFMXnFiPnFoNhOmlB3uB9clCh9daBa50LIiEiiTFAFRj5uPaIE6EKqu9ioN0VIyz6h5lKC3T1Vo5NYlvUwmjKiVO_sgBC-Uak542-XtGZ3WqXabWlBAEfqeMg5PVgkLX-2OdJj6z3NP5T4DwG-sXzvak Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 0ab28729cacc4da1a5025f52ac5f1127 Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:24:38.570803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ab28729cacc4da1a5025f52ac5f1127"}]}] Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 0ab28729cacc4da1a5025f52ac5f1127 Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotsTestJSON-2126543939-project Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: ed49dd65d33b408a8d4850c30e4e8a25 Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2126543939-project Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '20c33c32-b4fe-44f3-82e7-f413df7acbb7'} Jul 25 16:24:38.572017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. (HTTP 404) (Request-ID: req-dbbad552-3e67-4f3d-ad77-870eda1fe60b) Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:38.572904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:24:38.574229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 16:24:38.575479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eb97b29a-de89-43a3-a0ed-a4cb6b7ef451 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Returning 404 to user: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:38.576695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-eb97b29a-de89-43a3-a0ed-a4cb6b7ef451 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7" status: 404 len: 109 microversion: 2.1 time: 0.252058 Jul 25 16:24:38.580697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 29/39] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:38 2022] GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 => generated 109 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:24:38.603915 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-78890f9f-a687-4fad-95c7-29cf767b51ab tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f441056e940>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:38.721267 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-78890f9f-a687-4fad-95c7-29cf767b51ab tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] HTTP exception thrown: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-78890f9f-a687-4fad-95c7-29cf767b51ab tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Request method failure captured: Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 HTTP/1.1 Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sO1GPsmCJOcxkmD81Y87OvGFMXnFiPnFoNhOmlB3uB9clCh9daBa50LIiEiiTFAFRj5uPaIE6EKqu9ioN0VIyz6h5lKC3T1Vo5NYlvUwmjKiVO_sgBC-Uak542-XtGZ3WqXabWlBAEfqeMg5PVgkLX-2OdJj6z3NP5T4DwG-sXzvak Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 0ab28729cacc4da1a5025f52ac5f1127 Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:24:38.734224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ab28729cacc4da1a5025f52ac5f1127"}]}] Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 0ab28729cacc4da1a5025f52ac5f1127 Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotsTestJSON-2126543939-project Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: ed49dd65d33b408a8d4850c30e4e8a25 Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2126543939-project Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '20c33c32-b4fe-44f3-82e7-f413df7acbb7'} Jul 25 16:24:38.737025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. (HTTP 404) (Request-ID: req-b761edc0-7b5d-4b81-9731-a890085e6711) Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:38.739501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:24:38.748463 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 16:24:38.754599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-78890f9f-a687-4fad-95c7-29cf767b51ab tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Returning 404 to user: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-78890f9f-a687-4fad-95c7-29cf767b51ab tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7" status: 404 len: 109 microversion: 2.1 time: 0.138495 Jul 25 16:24:38.758973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 11/40] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:24:38 2022] DELETE /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:24:38.767183 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fdd632eb-ef11-436a-b236-6ef3e6843de7 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Calling method '.version_select at 0x7f4410eb4ca0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:38.827438 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-fdd632eb-ef11-436a-b236-6ef3e6843de7 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] HTTP exception thrown: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fdd632eb-ef11-436a-b236-6ef3e6843de7 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Request method failure captured: Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 HTTP/1.1 Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sO1GPsmCJOcxkmD81Y87OvGFMXnFiPnFoNhOmlB3uB9clCh9daBa50LIiEiiTFAFRj5uPaIE6EKqu9ioN0VIyz6h5lKC3T1Vo5NYlvUwmjKiVO_sgBC-Uak542-XtGZ3WqXabWlBAEfqeMg5PVgkLX-2OdJj6z3NP5T4DwG-sXzvak Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 0ab28729cacc4da1a5025f52ac5f1127 Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:24:38.830310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ab28729cacc4da1a5025f52ac5f1127"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ab28729cacc4da1a5025f52ac5f1127"}]}] Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 0ab28729cacc4da1a5025f52ac5f1127 Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2126543939 Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotsTestJSON-2126543939-project Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: ed49dd65d33b408a8d4850c30e4e8a25 Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2126543939-project Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '20c33c32-b4fe-44f3-82e7-f413df7acbb7'} Jul 25 16:24:38.832321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. (HTTP 404) (Request-ID: req-d6c3aaa9-d43a-4fb5-826f-1a0126cd7765) Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:38.833969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:24:38.837229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 16:24:38.841697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fdd632eb-ef11-436a-b236-6ef3e6843de7 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] Returning 404 to user: Volume 20c33c32-b4fe-44f3-82e7-f413df7acbb7 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fdd632eb-ef11-436a-b236-6ef3e6843de7 tempest-VolumesSnapshotsTestJSON-2126543939 tempest-VolumesSnapshotsTestJSON-2126543939-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7" status: 404 len: 109 microversion: 2.1 time: 0.083932 Jul 25 16:24:38.846226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 30/41] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:24:38 2022] GET /compute/v2.1/os-volumes/20c33c32-b4fe-44f3-82e7-f413df7acbb7 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:24:38.990420 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2a5703c-7473-49ee-8190-8b09f79b1a07 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:38.991767 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b2a5703c-7473-49ee-8190-8b09f79b1a07 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:39.032641 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2a5703c-7473-49ee-8190-8b09f79b1a07 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:39.039699 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2a5703c-7473-49ee-8190-8b09f79b1a07 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.044439 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2a5703c-7473-49ee-8190-8b09f79b1a07 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:39.050046 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b2a5703c-7473-49ee-8190-8b09f79b1a07 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:39.536970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b2a5703c-7473-49ee-8190-8b09f79b1a07 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:39.596902 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b2a5703c-7473-49ee-8190-8b09f79b1a07 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1265 microversion: 2.1 time: 0.611786 Jul 25 16:24:39.609858 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 12/42] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:38 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1265 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:39.720081 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3fda181d-eaf2-4d0b-9aa9-e540bd89df71 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'create', calling method: .version_select at 0x7f4410eb49d0>, body: {"keypair": {"name": "tempest-keypair-579592235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIhE8QVQW76qExAy/a+dgsG4vjxuYxqsX9Jyts6h4PvnQjVKPQL278zAdClmR3En25qJlDAoF+s+WqSyae72lNp8efYTgUV3o1hE4uLpNHYjHMLUG2p2HI7EEEAYqTUdQ=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:39.856138 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-3fda181d-eaf2-4d0b-9aa9-e540bd89df71 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Getting quotas for project 5c4be8083168475198c66cca890b18a9. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:39.873950 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-3fda181d-eaf2-4d0b-9aa9-e540bd89df71 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Getting quotas for user 644c0a532fa747c7abf4d53759e89181 and project 5c4be8083168475198c66cca890b18a9. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:40.107045 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3fda181d-eaf2-4d0b-9aa9-e540bd89df71 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.920838 Jul 25 16:24:40.108400 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 31/43] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:24:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:24:40.643868 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-98c1b854-5adc-487d-958c-2ced422e69c5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:40.649102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-98c1b854-5adc-487d-958c-2ced422e69c5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:40.696681 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98c1b854-5adc-487d-958c-2ced422e69c5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:40.704272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98c1b854-5adc-487d-958c-2ced422e69c5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:40.707615 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98c1b854-5adc-487d-958c-2ced422e69c5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:40.707849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98c1b854-5adc-487d-958c-2ced422e69c5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:41.201849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-98c1b854-5adc-487d-958c-2ced422e69c5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:41.226344 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-98c1b854-5adc-487d-958c-2ced422e69c5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1271 microversion: 2.1 time: 0.592007 Jul 25 16:24:41.230773 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 13/44] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:40 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1271 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:42.274458 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-031d1860-cfe8-424e-85a9-c3d8f77ef4ce tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:42.279584 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-031d1860-cfe8-424e-85a9-c3d8f77ef4ce tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:42.380810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-031d1860-cfe8-424e-85a9-c3d8f77ef4ce tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:42.388367 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-031d1860-cfe8-424e-85a9-c3d8f77ef4ce tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:42.402747 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-031d1860-cfe8-424e-85a9-c3d8f77ef4ce tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:42.402747 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-031d1860-cfe8-424e-85a9-c3d8f77ef4ce tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:43.158688 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-031d1860-cfe8-424e-85a9-c3d8f77ef4ce tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:43.217218 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-031d1860-cfe8-424e-85a9-c3d8f77ef4ce tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1271 microversion: 2.1 time: 0.937359 Jul 25 16:24:43.242150 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 32/45] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:42 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1271 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:43.391607 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-396882543", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:43.527481 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] validate_networks() for [('6ab96305-1028-4c5a-918e-429bbc4d3787', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:24:43.635864 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:44.284664 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f92e143a-867b-4582-a071-caf5e6a095fd tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:44.284664 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f92e143a-867b-4582-a071-caf5e6a095fd tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:44.294084 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f92e143a-867b-4582-a071-caf5e6a095fd tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:44.295228 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f92e143a-867b-4582-a071-caf5e6a095fd tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:44.296128 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f92e143a-867b-4582-a071-caf5e6a095fd tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:44.296577 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f92e143a-867b-4582-a071-caf5e6a095fd tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:44.750433 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f92e143a-867b-4582-a071-caf5e6a095fd tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:44.787561 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f92e143a-867b-4582-a071-caf5e6a095fd tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1271 microversion: 2.1 time: 0.507009 Jul 25 16:24:44.799611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 33/46] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:44 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1271 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:45.698439 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:24:45.699930 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:24:45.700617 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:24:45.701265 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:24:45.701970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:24:45.725493 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:45.728437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:45.732197 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:45.736289 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:45.804378 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Getting quotas for project 18b6e0eaf4eb48868a683c7769d3df7a. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:45.818558 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Getting quotas for user 2d1eb89923784f1c83d2077c6b6926e9 and project 18b6e0eaf4eb48868a683c7769d3df7a. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:45.834377 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-23889c06-60b9-4095-837a-c05aaae201b7 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:45.835544 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-23889c06-60b9-4095-837a-c05aaae201b7 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:45.857872 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:24:45.861134 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:24:45.874930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-23889c06-60b9-4095-837a-c05aaae201b7 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:45.875714 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-23889c06-60b9-4095-837a-c05aaae201b7 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:45.888167 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-23889c06-60b9-4095-837a-c05aaae201b7 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:45.889045 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-23889c06-60b9-4095-837a-c05aaae201b7 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:46.088651 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-be672d74-4244-444d-adb5-7e253b6575a8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.105708 Jul 25 16:24:46.098294 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 14/47] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:24:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 3116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 16:24:46.172401 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-30f3ccb6-7341-4395-aa53-162b186c56ae tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:46.173476 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-30f3ccb6-7341-4395-aa53-162b186c56ae tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:46.228920 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-23889c06-60b9-4095-837a-c05aaae201b7 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:46.340302 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-23889c06-60b9-4095-837a-c05aaae201b7 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1271 microversion: 2.1 time: 0.489751 Jul 25 16:24:46.377130 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 34/48] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:45 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1271 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:46.676650 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-30f3ccb6-7341-4395-aa53-162b186c56ae tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:46.711585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-30f3ccb6-7341-4395-aa53-162b186c56ae tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1221 microversion: 2.1 time: 0.601766 Jul 25 16:24:46.738392 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 15/49] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:46 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1221 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:47.388398 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7f416c59-02d9-4292-a4b0-eb50464c406e tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:47.390024 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7f416c59-02d9-4292-a4b0-eb50464c406e tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:47.437100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7f416c59-02d9-4292-a4b0-eb50464c406e tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:47.445422 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7f416c59-02d9-4292-a4b0-eb50464c406e tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:47.447608 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7f416c59-02d9-4292-a4b0-eb50464c406e tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:47.448186 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7f416c59-02d9-4292-a4b0-eb50464c406e tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:48.216524 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2035608481", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:48.537139 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] validate_networks() for [('6ab96305-1028-4c5a-918e-429bbc4d3787', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:24:49.139995 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7f416c59-02d9-4292-a4b0-eb50464c406e tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:49.166255 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7f416c59-02d9-4292-a4b0-eb50464c406e tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 1.791438 Jul 25 16:24:49.187228 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 35/50] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:47 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:50.194569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-20fe3f8e-cb64-4e47-9c89-d90db2efde3d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:50.195857 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-20fe3f8e-cb64-4e47-9c89-d90db2efde3d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:50.198405 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:50.250731 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20fe3f8e-cb64-4e47-9c89-d90db2efde3d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:50.251799 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20fe3f8e-cb64-4e47-9c89-d90db2efde3d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:50.265287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20fe3f8e-cb64-4e47-9c89-d90db2efde3d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:50.270616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20fe3f8e-cb64-4e47-9c89-d90db2efde3d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:53.549712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-20fe3f8e-cb64-4e47-9c89-d90db2efde3d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:53.583673 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-20fe3f8e-cb64-4e47-9c89-d90db2efde3d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 3.393482 Jul 25 16:24:53.594557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 36/51] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:50 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 3406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:54.619931 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d5820551-3263-44b4-8fee-c43462b4cff5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:54.628965 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d5820551-3263-44b4-8fee-c43462b4cff5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:54.646951 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5820551-3263-44b4-8fee-c43462b4cff5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:54.648108 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5820551-3263-44b4-8fee-c43462b4cff5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:54.669912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5820551-3263-44b4-8fee-c43462b4cff5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:54.671031 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5820551-3263-44b4-8fee-c43462b4cff5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:55.061854 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:24:55.062842 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:24:55.063195 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:24:55.063962 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:24:55.064712 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:24:55.092578 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:24:55.156729 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:55.157612 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:55.159139 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:55.159967 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:55.340381 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Getting quotas for project 18b6e0eaf4eb48868a683c7769d3df7a. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:24:55.367728 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Getting quotas for user 2d1eb89923784f1c83d2077c6b6926e9 and project 18b6e0eaf4eb48868a683c7769d3df7a. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:24:55.441365 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:24:55.455729 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:24:55.717590 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-85f702be-aa8d-44fb-939a-b0ce5ea1e4cf tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.506263 Jul 25 16:24:55.732546 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 16/52] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:24:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 7522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:24:55.745748 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fdb11372-1091-4b5f-882e-5cf762f65aa4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:55.747295 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fdb11372-1091-4b5f-882e-5cf762f65aa4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:56.707668 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fdb11372-1091-4b5f-882e-5cf762f65aa4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:56.723229 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fdb11372-1091-4b5f-882e-5cf762f65aa4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1222 microversion: 2.1 time: 0.988230 Jul 25 16:24:56.725667 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 17/53] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:55 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1222 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:56.843864 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d5820551-3263-44b4-8fee-c43462b4cff5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:56.887371 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d5820551-3263-44b4-8fee-c43462b4cff5 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 2.266270 Jul 25 16:24:56.890546 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 37/54] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:54 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:24:57.356789 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d8424c66-f835-4259-aa62-8dab4267b91e req-86abf19d-c47f-4524-aee1-e4e2ef7bc267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b45fcf-8fc0-4e1a-9257-81beff81ee3d", "tag": "410ca3cd-385e-464e-9409-2b05ac233c4f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:57.416173 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d8424c66-f835-4259-aa62-8dab4267b91e req-86abf19d-c47f-4524-aee1-e4e2ef7bc267 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:57.427510 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d8424c66-f835-4259-aa62-8dab4267b91e req-86abf19d-c47f-4524-aee1-e4e2ef7bc267 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:57.513309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d8424c66-f835-4259-aa62-8dab4267b91e req-86abf19d-c47f-4524-aee1-e4e2ef7bc267 service nova] Creating event network-changed:410ca3cd-385e-464e-9409-2b05ac233c4f for instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d on hv-cinder-83697 Jul 25 16:24:57.536477 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d8424c66-f835-4259-aa62-8dab4267b91e req-86abf19d-c47f-4524-aee1-e4e2ef7bc267 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:24:57.540913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e2a-d8dc-41ed-a80e-bef6af0e278c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:57.541395 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e2a-d8dc-41ed-a80e-bef6af0e278c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:57.542368 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e2a-d8dc-41ed-a80e-bef6af0e278c None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:57.542794 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e2a-d8dc-41ed-a80e-bef6af0e278c None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:57.576238 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.compute.rpcapi [None req-2f2a4e2a-d8dc-41ed-a80e-bef6af0e278c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 16:24:57.579897 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f2a4e2a-d8dc-41ed-a80e-bef6af0e278c None None] Releasing lock "compute-rpcapi-router" {{(pid=117920) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:24:57.663929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f2a4e2a-d8dc-41ed-a80e-bef6af0e278c None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.936483 Jul 25 16:24:57.665592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 18/55] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:24:57.753804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cc360e0a-0b34-4f4f-b058-2362b161ac02 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:57.755248 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cc360e0a-0b34-4f4f-b058-2362b161ac02 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:57.768488 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc360e0a-0b34-4f4f-b058-2362b161ac02 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:57.773959 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc360e0a-0b34-4f4f-b058-2362b161ac02 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:57.778899 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc360e0a-0b34-4f4f-b058-2362b161ac02 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:57.783778 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc360e0a-0b34-4f4f-b058-2362b161ac02 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:57.918933 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-27302231-cffd-443f-ad64-38a1290fcd2b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:24:57.920454 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-27302231-cffd-443f-ad64-38a1290fcd2b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:24:57.940424 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27302231-cffd-443f-ad64-38a1290fcd2b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:57.940924 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27302231-cffd-443f-ad64-38a1290fcd2b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:57.941946 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27302231-cffd-443f-ad64-38a1290fcd2b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:24:57.942405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-27302231-cffd-443f-ad64-38a1290fcd2b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:24:59.081278 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cc360e0a-0b34-4f4f-b058-2362b161ac02 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:59.104355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cc360e0a-0b34-4f4f-b058-2362b161ac02 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1226 microversion: 2.1 time: 1.355141 Jul 25 16:24:59.116053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 38/56] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:57 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1226 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:24:59.734058 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1285432498", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab360f41-bf62-4a29-ad06-3a6595fd95fd"}], "security_groups": [{"name": "tempest-securitygroup--1255283347"}], "key_name": "tempest-keypair-579592235", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:24:59.774924 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-27302231-cffd-443f-ad64-38a1290fcd2b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:24:59.786509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-27302231-cffd-443f-ad64-38a1290fcd2b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 1.872727 Jul 25 16:24:59.812583 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 19/57] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:24:57 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:00.102467 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] validate_networks() for [('ab360f41-bf62-4a29-ad06-3a6595fd95fd', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:25:00.158043 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d307b8a1-8038-46ad-8a44-4b8a81661b66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:00.159294 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d307b8a1-8038-46ad-8a44-4b8a81661b66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:00.189712 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d307b8a1-8038-46ad-8a44-4b8a81661b66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:00.199146 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d307b8a1-8038-46ad-8a44-4b8a81661b66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:00.200684 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d307b8a1-8038-46ad-8a44-4b8a81661b66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:00.207194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d307b8a1-8038-46ad-8a44-4b8a81661b66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:00.839031 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d307b8a1-8038-46ad-8a44-4b8a81661b66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:00.889643 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d307b8a1-8038-46ad-8a44-4b8a81661b66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1280 microversion: 2.1 time: 0.733531 Jul 25 16:25:00.893201 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 20/58] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:00 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1280 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:00.920451 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-485e417f-cdd3-4e6e-992d-4b24294f1293 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:00.924474 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-485e417f-cdd3-4e6e-992d-4b24294f1293 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:00.965964 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485e417f-cdd3-4e6e-992d-4b24294f1293 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:00.966441 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485e417f-cdd3-4e6e-992d-4b24294f1293 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:00.967367 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485e417f-cdd3-4e6e-992d-4b24294f1293 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:00.967949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-485e417f-cdd3-4e6e-992d-4b24294f1293 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:01.422672 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:01.584557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-485e417f-cdd3-4e6e-992d-4b24294f1293 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:01.616064 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-485e417f-cdd3-4e6e-992d-4b24294f1293 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.718879 Jul 25 16:25:01.622452 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 21/59] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:00 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:01.946268 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-95ae06ee-37f6-4e77-b033-db177b63be6f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:01.947272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-95ae06ee-37f6-4e77-b033-db177b63be6f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:01.981524 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ae06ee-37f6-4e77-b033-db177b63be6f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:02.002858 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ae06ee-37f6-4e77-b033-db177b63be6f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:02.005000 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ae06ee-37f6-4e77-b033-db177b63be6f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:02.009947 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-95ae06ee-37f6-4e77-b033-db177b63be6f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:02.038894 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=41 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:02.267518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-95ae06ee-37f6-4e77-b033-db177b63be6f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:02.296199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-95ae06ee-37f6-4e77-b033-db177b63be6f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1280 microversion: 2.1 time: 0.362458 Jul 25 16:25:02.296199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 22/60] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:01 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1280 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:02.660365 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3b0ee894-c81b-49cf-90d3-764633ae18b6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:02.672668 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3b0ee894-c81b-49cf-90d3-764633ae18b6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:02.729148 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b0ee894-c81b-49cf-90d3-764633ae18b6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:02.730014 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b0ee894-c81b-49cf-90d3-764633ae18b6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:02.739165 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b0ee894-c81b-49cf-90d3-764633ae18b6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:02.740095 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3b0ee894-c81b-49cf-90d3-764633ae18b6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:03.590546 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:25:03.591551 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:25:03.591687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:25:03.592075 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:25:03.592572 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:25:03.642109 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:03.642933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:03.644076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:03.644750 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:03.792790 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Getting quotas for project 5c4be8083168475198c66cca890b18a9. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:25:03.814245 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Getting quotas for user 644c0a532fa747c7abf4d53759e89181 and project 5c4be8083168475198c66cca890b18a9. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:25:03.885173 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:25:03.895272 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:25:03.962285 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3b0ee894-c81b-49cf-90d3-764633ae18b6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:03.989000 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3b0ee894-c81b-49cf-90d3-764633ae18b6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 1.338679 Jul 25 16:25:04.007735 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 23/61] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:02 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:04.028129 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-61103b92-0d11-45e9-a57b-2d84a87e19ef tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:04.029138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-61103b92-0d11-45e9-a57b-2d84a87e19ef tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:04.046266 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61103b92-0d11-45e9-a57b-2d84a87e19ef tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:04.050968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61103b92-0d11-45e9-a57b-2d84a87e19ef tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:04.052351 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61103b92-0d11-45e9-a57b-2d84a87e19ef tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:04.053739 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-61103b92-0d11-45e9-a57b-2d84a87e19ef tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:04.323906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-40199dc3-12b6-4038-ab41-3dfef57d0c98 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.593927 Jul 25 16:25:04.332830 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 39/62] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:24:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 4606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:25:04.357881 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7656dc52-65e7-4758-8a83-577d7ab0bf75 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:04.362416 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7656dc52-65e7-4758-8a83-577d7ab0bf75 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:04.554654 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-61103b92-0d11-45e9-a57b-2d84a87e19ef tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:04.587188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-61103b92-0d11-45e9-a57b-2d84a87e19ef tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1280 microversion: 2.1 time: 0.567921 Jul 25 16:25:04.602077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 24/63] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:04 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1280 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:04.874783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7656dc52-65e7-4758-8a83-577d7ab0bf75 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:04.966187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7656dc52-65e7-4758-8a83-577d7ab0bf75 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1237 microversion: 2.1 time: 0.617563 Jul 25 16:25:04.969836 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 40/64] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:04 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1237 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:05.029211 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dc0195d7-0b61-4185-94b3-f81db4e82674 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:05.030561 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dc0195d7-0b61-4185-94b3-f81db4e82674 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:05.044437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc0195d7-0b61-4185-94b3-f81db4e82674 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:05.045309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc0195d7-0b61-4185-94b3-f81db4e82674 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:05.047913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc0195d7-0b61-4185-94b3-f81db4e82674 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:05.048898 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc0195d7-0b61-4185-94b3-f81db4e82674 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:05.510843 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dc0195d7-0b61-4185-94b3-f81db4e82674 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:05.522630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dc0195d7-0b61-4185-94b3-f81db4e82674 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.502121 Jul 25 16:25:05.526624 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 25/65] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:05 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:05.648735 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-14b33cf1-bc32-40d7-b071-be21937baf30 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:05.648735 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-14b33cf1-bc32-40d7-b071-be21937baf30 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:05.680754 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14b33cf1-bc32-40d7-b071-be21937baf30 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:05.689774 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14b33cf1-bc32-40d7-b071-be21937baf30 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:05.691598 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14b33cf1-bc32-40d7-b071-be21937baf30 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:05.701304 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14b33cf1-bc32-40d7-b071-be21937baf30 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:05.881573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-14b33cf1-bc32-40d7-b071-be21937baf30 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:05.906370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-14b33cf1-bc32-40d7-b071-be21937baf30 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1280 microversion: 2.1 time: 0.266440 Jul 25 16:25:05.915872 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 41/66] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:05 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1280 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:06.008104 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-64b44922-3a71-4464-84ee-a91439ad1229 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:06.009194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-64b44922-3a71-4464-84ee-a91439ad1229 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:06.116903 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-64b44922-3a71-4464-84ee-a91439ad1229 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:06.134752 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=29 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:06.139768 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-64b44922-3a71-4464-84ee-a91439ad1229 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1237 microversion: 2.1 time: 0.136176 Jul 25 16:25:06.141666 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 26/67] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:06 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1237 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:06.568512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f8cd6cbb-fd31-4377-a024-11b1d2fdaa8d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:06.569785 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f8cd6cbb-fd31-4377-a024-11b1d2fdaa8d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:06.589781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8cd6cbb-fd31-4377-a024-11b1d2fdaa8d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:06.606523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8cd6cbb-fd31-4377-a024-11b1d2fdaa8d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:06.610007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8cd6cbb-fd31-4377-a024-11b1d2fdaa8d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:06.611276 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f8cd6cbb-fd31-4377-a024-11b1d2fdaa8d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:06.974636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c7096856-661a-46e5-9bc4-1a1fff660a36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:06.977215 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c7096856-661a-46e5-9bc4-1a1fff660a36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:07.024885 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7096856-661a-46e5-9bc4-1a1fff660a36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:07.025589 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7096856-661a-46e5-9bc4-1a1fff660a36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:07.035663 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7096856-661a-46e5-9bc4-1a1fff660a36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:07.037654 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c7096856-661a-46e5-9bc4-1a1fff660a36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:07.199727 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f8cd6cbb-fd31-4377-a024-11b1d2fdaa8d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:07.216237 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f8cd6cbb-fd31-4377-a024-11b1d2fdaa8d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.650387 Jul 25 16:25:07.218187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 42/68] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:06 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:07.230627 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7264d2c0-a17e-4e75-85fe-3243292503a4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:07.233677 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7264d2c0-a17e-4e75-85fe-3243292503a4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:07.285066 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7264d2c0-a17e-4e75-85fe-3243292503a4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:07.291535 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7264d2c0-a17e-4e75-85fe-3243292503a4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:07.294901 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7264d2c0-a17e-4e75-85fe-3243292503a4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:07.297202 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7264d2c0-a17e-4e75-85fe-3243292503a4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:07.565245 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:07.646505 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7264d2c0-a17e-4e75-85fe-3243292503a4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:07.677946 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7264d2c0-a17e-4e75-85fe-3243292503a4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1241 microversion: 2.1 time: 0.456234 Jul 25 16:25:07.701917 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 43/69] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:07 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1241 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:07.754170 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c7096856-661a-46e5-9bc4-1a1fff660a36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:07.768625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c7096856-661a-46e5-9bc4-1a1fff660a36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.814405 Jul 25 16:25:07.769310 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 27/70] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:06 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:08.266888 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2c18783a-a57e-468c-84d8-b55db0ee11d8 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:08.267513 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2c18783a-a57e-468c-84d8-b55db0ee11d8 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:08.286299 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c18783a-a57e-468c-84d8-b55db0ee11d8 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:08.287745 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c18783a-a57e-468c-84d8-b55db0ee11d8 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.288879 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c18783a-a57e-468c-84d8-b55db0ee11d8 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:08.289754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2c18783a-a57e-468c-84d8-b55db0ee11d8 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.459970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-93c5bcd5-fb92-4f4d-8777-85b96cd598f1 req-bcb5f2c9-b53a-4082-8e99-89d58561d9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c89d38b5-02b2-4e63-8dca-04b967a8cf14", "tag": "bb0ff5b2-c268-4b5d-85a0-55179d065cdf"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:08.495198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-93c5bcd5-fb92-4f4d-8777-85b96cd598f1 req-bcb5f2c9-b53a-4082-8e99-89d58561d9ce service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:08.502668 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-93c5bcd5-fb92-4f4d-8777-85b96cd598f1 req-bcb5f2c9-b53a-4082-8e99-89d58561d9ce service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.528816 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-93c5bcd5-fb92-4f4d-8777-85b96cd598f1 req-bcb5f2c9-b53a-4082-8e99-89d58561d9ce service nova] Creating event network-changed:bb0ff5b2-c268-4b5d-85a0-55179d065cdf for instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 on hv-cinder-83697 Jul 25 16:25:08.529698 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-93c5bcd5-fb92-4f4d-8777-85b96cd598f1 req-bcb5f2c9-b53a-4082-8e99-89d58561d9ce service nova] Acquired lock "compute-rpcapi-router" {{(pid=117919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 16:25:08.531861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c8b553-bbf1-401a-8d35-f0d8f3e6520b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:08.532535 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c8b553-bbf1-401a-8d35-f0d8f3e6520b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.534185 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c8b553-bbf1-401a-8d35-f0d8f3e6520b None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:08.535667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c8b553-bbf1-401a-8d35-f0d8f3e6520b None None] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.548451 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.compute.rpcapi [None req-b3c8b553-bbf1-401a-8d35-f0d8f3e6520b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 16:25:08.549781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c8b553-bbf1-401a-8d35-f0d8f3e6520b None None] Releasing lock "compute-rpcapi-router" {{(pid=117919) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 16:25:08.587759 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b3c8b553-bbf1-401a-8d35-f0d8f3e6520b None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344465 Jul 25 16:25:08.588992 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 44/71] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:08.639261 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2c18783a-a57e-468c-84d8-b55db0ee11d8 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:08.663139 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2c18783a-a57e-468c-84d8-b55db0ee11d8 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.411829 Jul 25 16:25:08.665327 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 28/72] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:08 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:08.722999 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a9c9efc3-5065-448c-b833-7a66a9b1b4fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:08.724456 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a9c9efc3-5065-448c-b833-7a66a9b1b4fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:08.735367 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9c9efc3-5065-448c-b833-7a66a9b1b4fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:08.736524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9c9efc3-5065-448c-b833-7a66a9b1b4fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.738272 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9c9efc3-5065-448c-b833-7a66a9b1b4fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:08.739303 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9c9efc3-5065-448c-b833-7a66a9b1b4fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.810021 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-797b1b08-9574-4150-b9f9-25c57b87c43f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:08.823112 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-797b1b08-9574-4150-b9f9-25c57b87c43f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:08.837786 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-797b1b08-9574-4150-b9f9-25c57b87c43f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:08.838376 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-797b1b08-9574-4150-b9f9-25c57b87c43f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.839283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-797b1b08-9574-4150-b9f9-25c57b87c43f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:08.839950 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-797b1b08-9574-4150-b9f9-25c57b87c43f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:08.897296 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a9c9efc3-5065-448c-b833-7a66a9b1b4fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:08.922243 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a9c9efc3-5065-448c-b833-7a66a9b1b4fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1233 microversion: 2.1 time: 0.205484 Jul 25 16:25:08.928240 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 45/73] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:08 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1233 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:09.114445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-797b1b08-9574-4150-b9f9-25c57b87c43f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:09.126332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-797b1b08-9574-4150-b9f9-25c57b87c43f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.333102 Jul 25 16:25:09.127629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 29/74] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:08 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:09.705427 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-67f70cc5-c004-408e-a380-662f01b4be35 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:09.706588 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-67f70cc5-c004-408e-a380-662f01b4be35 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:09.753065 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f70cc5-c004-408e-a380-662f01b4be35 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:09.765438 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f70cc5-c004-408e-a380-662f01b4be35 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:09.767770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f70cc5-c004-408e-a380-662f01b4be35 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:09.768830 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67f70cc5-c004-408e-a380-662f01b4be35 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:09.974881 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d8c88e4-83b2-4b23-905c-62c331bff09e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:09.978972 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7d8c88e4-83b2-4b23-905c-62c331bff09e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:09.991520 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d8c88e4-83b2-4b23-905c-62c331bff09e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:09.992714 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d8c88e4-83b2-4b23-905c-62c331bff09e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:09.994497 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d8c88e4-83b2-4b23-905c-62c331bff09e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:09.995795 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d8c88e4-83b2-4b23-905c-62c331bff09e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:10.370579 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7d8c88e4-83b2-4b23-905c-62c331bff09e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:10.393151 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7d8c88e4-83b2-4b23-905c-62c331bff09e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1289 microversion: 2.1 time: 0.422448 Jul 25 16:25:10.409386 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 30/75] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:09 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1289 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:10.427436 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc44ec3c-d3f6-4c84-a68a-e67d8ca5f63c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:10.428699 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc44ec3c-d3f6-4c84-a68a-e67d8ca5f63c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:10.465308 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc44ec3c-d3f6-4c84-a68a-e67d8ca5f63c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:10.469001 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc44ec3c-d3f6-4c84-a68a-e67d8ca5f63c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:10.476903 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc44ec3c-d3f6-4c84-a68a-e67d8ca5f63c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:10.478936 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc44ec3c-d3f6-4c84-a68a-e67d8ca5f63c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:10.925925 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-67f70cc5-c004-408e-a380-662f01b4be35 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:10.946530 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-67f70cc5-c004-408e-a380-662f01b4be35 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 1.252903 Jul 25 16:25:10.953199 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 46/76] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:09 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:10.967099 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-170ad21c-2688-4f24-af4e-a1751d1ce46c req-d1fe0c59-757a-4e10-8c54-4451448df089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a766e06-b19b-4fd9-9f31-7ef4af533654", "tag": "1ea0fdf3-0f2b-440a-ac9c-39e48abc4a64"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:11.014269 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-170ad21c-2688-4f24-af4e-a1751d1ce46c req-d1fe0c59-757a-4e10-8c54-4451448df089 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:11.014717 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-170ad21c-2688-4f24-af4e-a1751d1ce46c req-d1fe0c59-757a-4e10-8c54-4451448df089 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:11.064342 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-170ad21c-2688-4f24-af4e-a1751d1ce46c req-d1fe0c59-757a-4e10-8c54-4451448df089 service nova] Creating event network-changed:1ea0fdf3-0f2b-440a-ac9c-39e48abc4a64 for instance 9a766e06-b19b-4fd9-9f31-7ef4af533654 on hv-cinder-83697 Jul 25 16:25:11.076802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-170ad21c-2688-4f24-af4e-a1751d1ce46c req-d1fe0c59-757a-4e10-8c54-4451448df089 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118742 Jul 25 16:25:11.081214 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 47/77] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:11.422593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bc44ec3c-d3f6-4c84-a68a-e67d8ca5f63c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:11.460006 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b3c03326-1342-4254-8049-2a7413e313c7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:11.465375 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b3c03326-1342-4254-8049-2a7413e313c7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:11.477074 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc44ec3c-d3f6-4c84-a68a-e67d8ca5f63c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 1.080025 Jul 25 16:25:11.483196 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 31/78] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:10 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:11.490208 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c03326-1342-4254-8049-2a7413e313c7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:11.491737 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c03326-1342-4254-8049-2a7413e313c7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:11.494096 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c03326-1342-4254-8049-2a7413e313c7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:11.495648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b3c03326-1342-4254-8049-2a7413e313c7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:11.639344 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b3c03326-1342-4254-8049-2a7413e313c7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:11.657652 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b3c03326-1342-4254-8049-2a7413e313c7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1295 microversion: 2.1 time: 0.224424 Jul 25 16:25:11.659548 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 48/79] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:11 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1295 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:11.998438 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb1b8f9f-1233-4627-b021-725e4581738b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:12.021995 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb1b8f9f-1233-4627-b021-725e4581738b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:12.052242 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb1b8f9f-1233-4627-b021-725e4581738b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:12.053446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb1b8f9f-1233-4627-b021-725e4581738b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:12.055102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb1b8f9f-1233-4627-b021-725e4581738b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:12.056111 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb1b8f9f-1233-4627-b021-725e4581738b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:12.283954 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb1b8f9f-1233-4627-b021-725e4581738b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:12.298611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb1b8f9f-1233-4627-b021-725e4581738b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.304130 Jul 25 16:25:12.299929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 32/80] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:11 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:12.509104 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e785a422-6f46-4026-9b81-b18e6dd5382d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:12.510347 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e785a422-6f46-4026-9b81-b18e6dd5382d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:12.519541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e785a422-6f46-4026-9b81-b18e6dd5382d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:12.519990 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e785a422-6f46-4026-9b81-b18e6dd5382d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:12.520781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e785a422-6f46-4026-9b81-b18e6dd5382d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:12.521225 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e785a422-6f46-4026-9b81-b18e6dd5382d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:12.525984 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=87 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:12.699726 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1171d85-d0df-46ab-9a54-2767604e1f25 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:12.702045 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1171d85-d0df-46ab-9a54-2767604e1f25 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:12.711639 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1171d85-d0df-46ab-9a54-2767604e1f25 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:12.712898 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1171d85-d0df-46ab-9a54-2767604e1f25 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:12.714321 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1171d85-d0df-46ab-9a54-2767604e1f25 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:12.714771 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1171d85-d0df-46ab-9a54-2767604e1f25 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:12.736845 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e785a422-6f46-4026-9b81-b18e6dd5382d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:12.750592 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e785a422-6f46-4026-9b81-b18e6dd5382d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.247696 Jul 25 16:25:12.751942 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 49/81] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:12 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:12.800108 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1171d85-d0df-46ab-9a54-2767604e1f25 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:12.809904 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1171d85-d0df-46ab-9a54-2767604e1f25 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1295 microversion: 2.1 time: 0.117778 Jul 25 16:25:12.810289 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 33/82] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:12 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1295 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:13.327195 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-14034313-968c-4e02-9002-cc033fd7de4b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:13.328299 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-14034313-968c-4e02-9002-cc033fd7de4b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:13.341573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14034313-968c-4e02-9002-cc033fd7de4b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.342306 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14034313-968c-4e02-9002-cc033fd7de4b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.343813 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14034313-968c-4e02-9002-cc033fd7de4b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.344598 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14034313-968c-4e02-9002-cc033fd7de4b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.729205 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-14034313-968c-4e02-9002-cc033fd7de4b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:13.738177 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-14034313-968c-4e02-9002-cc033fd7de4b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.419154 Jul 25 16:25:13.739112 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 50/83] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:13 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:13.788162 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c932913-4faa-49b1-bfad-8b006199fdd8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:13.789263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8c932913-4faa-49b1-bfad-8b006199fdd8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:13.800229 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c932913-4faa-49b1-bfad-8b006199fdd8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.800979 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c932913-4faa-49b1-bfad-8b006199fdd8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.802363 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c932913-4faa-49b1-bfad-8b006199fdd8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.803101 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c932913-4faa-49b1-bfad-8b006199fdd8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.838506 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d26b23f7-6c20-436c-a3bc-3031678c37a7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:13.839770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d26b23f7-6c20-436c-a3bc-3031678c37a7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:13.851028 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d26b23f7-6c20-436c-a3bc-3031678c37a7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.851793 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d26b23f7-6c20-436c-a3bc-3031678c37a7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.853199 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d26b23f7-6c20-436c-a3bc-3031678c37a7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:13.853989 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d26b23f7-6c20-436c-a3bc-3031678c37a7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:13.946770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d26b23f7-6c20-436c-a3bc-3031678c37a7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:13.959613 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d26b23f7-6c20-436c-a3bc-3031678c37a7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1295 microversion: 2.1 time: 0.128267 Jul 25 16:25:13.961577 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 51/84] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:13 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1295 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:13.996096 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c932913-4faa-49b1-bfad-8b006199fdd8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:14.009458 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8c932913-4faa-49b1-bfad-8b006199fdd8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.228114 Jul 25 16:25:14.010516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 34/85] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:13 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:14.762248 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a522effd-506b-42e1-afcf-1d7bb3421930 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:14.763775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a522effd-506b-42e1-afcf-1d7bb3421930 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:14.771112 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a522effd-506b-42e1-afcf-1d7bb3421930 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:14.771945 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a522effd-506b-42e1-afcf-1d7bb3421930 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:14.772892 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a522effd-506b-42e1-afcf-1d7bb3421930 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:14.773607 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a522effd-506b-42e1-afcf-1d7bb3421930 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:14.957894 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=8 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:14.992821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-db5cd727-a29c-47c0-82e0-1e8d67b31b2d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:14.994992 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-db5cd727-a29c-47c0-82e0-1e8d67b31b2d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:15.006094 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db5cd727-a29c-47c0-82e0-1e8d67b31b2d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:15.007316 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db5cd727-a29c-47c0-82e0-1e8d67b31b2d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:15.008928 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db5cd727-a29c-47c0-82e0-1e8d67b31b2d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:15.010484 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db5cd727-a29c-47c0-82e0-1e8d67b31b2d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:15.396285 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-db5cd727-a29c-47c0-82e0-1e8d67b31b2d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:15.423160 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-db5cd727-a29c-47c0-82e0-1e8d67b31b2d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1295 microversion: 2.1 time: 0.442535 Jul 25 16:25:15.426383 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 35/86] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:14 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1295 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:15.465627 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-389db869-1f7d-4ccd-aa47-bb009558de38 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:15.484223 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-389db869-1f7d-4ccd-aa47-bb009558de38 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:15.516435 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-389db869-1f7d-4ccd-aa47-bb009558de38 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:15.518220 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-389db869-1f7d-4ccd-aa47-bb009558de38 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:15.524002 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-389db869-1f7d-4ccd-aa47-bb009558de38 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:15.524829 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-389db869-1f7d-4ccd-aa47-bb009558de38 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:15.835406 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a522effd-506b-42e1-afcf-1d7bb3421930 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:15.867500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a522effd-506b-42e1-afcf-1d7bb3421930 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 1.109616 Jul 25 16:25:15.874466 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 52/87] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:14 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:16.464184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e1981319-0335-4a34-b69f-711492a7c849 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:16.465619 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e1981319-0335-4a34-b69f-711492a7c849 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:16.490911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1981319-0335-4a34-b69f-711492a7c849 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:16.499334 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1981319-0335-4a34-b69f-711492a7c849 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:16.500894 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1981319-0335-4a34-b69f-711492a7c849 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:16.501549 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e1981319-0335-4a34-b69f-711492a7c849 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:16.528239 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-389db869-1f7d-4ccd-aa47-bb009558de38 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:16.558710 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-389db869-1f7d-4ccd-aa47-bb009558de38 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 1.129754 Jul 25 16:25:16.578182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 36/88] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:15 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:16.905245 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-51f69b76-09a7-41e3-9e14-3df72e890a36 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:16.906307 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-51f69b76-09a7-41e3-9e14-3df72e890a36 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:16.924758 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51f69b76-09a7-41e3-9e14-3df72e890a36 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:16.925519 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51f69b76-09a7-41e3-9e14-3df72e890a36 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:16.926928 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51f69b76-09a7-41e3-9e14-3df72e890a36 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:16.927696 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-51f69b76-09a7-41e3-9e14-3df72e890a36 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:16.961878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:17.261192 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e1981319-0335-4a34-b69f-711492a7c849 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:17.300812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e1981319-0335-4a34-b69f-711492a7c849 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.841703 Jul 25 16:25:17.303435 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 53/89] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:16 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:17.497237 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-51f69b76-09a7-41e3-9e14-3df72e890a36 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:17.561286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-51f69b76-09a7-41e3-9e14-3df72e890a36 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.662134 Jul 25 16:25:17.565304 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 37/90] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:16 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:17.610773 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-257d09e9-7bec-4b7d-8af2-8576723b09e7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:17.617538 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-257d09e9-7bec-4b7d-8af2-8576723b09e7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:17.651777 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257d09e9-7bec-4b7d-8af2-8576723b09e7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:17.652954 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257d09e9-7bec-4b7d-8af2-8576723b09e7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:17.654501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257d09e9-7bec-4b7d-8af2-8576723b09e7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:17.655381 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-257d09e9-7bec-4b7d-8af2-8576723b09e7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:17.716060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-bac0b9a8-7666-4cca-9f10-77a98d885eb5 req-ec6dad38-4f54-4bf7-a4b3-ff6be461cfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c89d38b5-02b2-4e63-8dca-04b967a8cf14", "name": "network-vif-plugged", "status": "completed", "tag": "bb0ff5b2-c268-4b5d-85a0-55179d065cdf"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:17.771214 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-bac0b9a8-7666-4cca-9f10-77a98d885eb5 req-ec6dad38-4f54-4bf7-a4b3-ff6be461cfe5 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:17.772018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-bac0b9a8-7666-4cca-9f10-77a98d885eb5 req-ec6dad38-4f54-4bf7-a4b3-ff6be461cfe5 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:17.818052 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-bac0b9a8-7666-4cca-9f10-77a98d885eb5 req-ec6dad38-4f54-4bf7-a4b3-ff6be461cfe5 service nova] Creating event network-vif-plugged:bb0ff5b2-c268-4b5d-85a0-55179d065cdf for instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 on hv-cinder-83697 Jul 25 16:25:17.835915 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-bac0b9a8-7666-4cca-9f10-77a98d885eb5 req-ec6dad38-4f54-4bf7-a4b3-ff6be461cfe5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.435165 Jul 25 16:25:17.837021 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 54/91] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:25:18.330364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-257d09e9-7bec-4b7d-8af2-8576723b09e7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:18.331594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5932e0ba-a499-41f3-9844-b31215bfc6fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:18.333019 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5932e0ba-a499-41f3-9844-b31215bfc6fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:18.347542 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-257d09e9-7bec-4b7d-8af2-8576723b09e7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.748793 Jul 25 16:25:18.349860 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 38/92] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:17 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:18.375001 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5932e0ba-a499-41f3-9844-b31215bfc6fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.376045 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5932e0ba-a499-41f3-9844-b31215bfc6fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.377598 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5932e0ba-a499-41f3-9844-b31215bfc6fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.378370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5932e0ba-a499-41f3-9844-b31215bfc6fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.547092 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:18.612503 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-63ef2770-b31f-4dc5-8441-2546ee080cbb tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:18.614629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-63ef2770-b31f-4dc5-8441-2546ee080cbb tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:18.627721 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63ef2770-b31f-4dc5-8441-2546ee080cbb tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.628807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63ef2770-b31f-4dc5-8441-2546ee080cbb tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.630567 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63ef2770-b31f-4dc5-8441-2546ee080cbb tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.631667 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-63ef2770-b31f-4dc5-8441-2546ee080cbb tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.877849 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5932e0ba-a499-41f3-9844-b31215bfc6fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:18.896530 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5932e0ba-a499-41f3-9844-b31215bfc6fa tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.573694 Jul 25 16:25:18.896934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 55/93] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:18 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:18.902094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-c4a98799-1c65-4d7c-a1b2-1aa1af7d0765 req-4b107961-63a2-4c06-8ebd-ed02bd2f8519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfffb541-3a46-4a3f-ad6c-8d7a88586b23", "tag": "aaea7be2-6388-4c1f-8fe7-40d03b69cf00"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:18.930247 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c4a98799-1c65-4d7c-a1b2-1aa1af7d0765 req-4b107961-63a2-4c06-8ebd-ed02bd2f8519 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:18.930692 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c4a98799-1c65-4d7c-a1b2-1aa1af7d0765 req-4b107961-63a2-4c06-8ebd-ed02bd2f8519 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:18.963399 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-c4a98799-1c65-4d7c-a1b2-1aa1af7d0765 req-4b107961-63a2-4c06-8ebd-ed02bd2f8519 service nova] Creating event network-changed:aaea7be2-6388-4c1f-8fe7-40d03b69cf00 for instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 on hv-cinder-83697 Jul 25 16:25:18.971603 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-c4a98799-1c65-4d7c-a1b2-1aa1af7d0765 req-4b107961-63a2-4c06-8ebd-ed02bd2f8519 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073332 Jul 25 16:25:18.972727 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 56/94] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:19.016617 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-63ef2770-b31f-4dc5-8441-2546ee080cbb tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:19.019424 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:19.034214 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-63ef2770-b31f-4dc5-8441-2546ee080cbb tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.428366 Jul 25 16:25:19.036624 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 39/95] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:18 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:19.386539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-28566a2b-6db2-4b3d-abba-bc1e742444cd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:19.387456 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-28566a2b-6db2-4b3d-abba-bc1e742444cd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:19.397638 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28566a2b-6db2-4b3d-abba-bc1e742444cd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:19.398759 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28566a2b-6db2-4b3d-abba-bc1e742444cd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:19.400209 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28566a2b-6db2-4b3d-abba-bc1e742444cd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:19.400907 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-28566a2b-6db2-4b3d-abba-bc1e742444cd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:19.627085 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-28566a2b-6db2-4b3d-abba-bc1e742444cd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:19.636605 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-28566a2b-6db2-4b3d-abba-bc1e742444cd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.256618 Jul 25 16:25:19.637835 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 57/96] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:19 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:19.879823 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-19211c9b-72fb-426e-83e6-dc46de05c6c3 req-f05b6a60-dba2-4c1a-80a6-c78aa1d08f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b45fcf-8fc0-4e1a-9257-81beff81ee3d", "name": "network-vif-plugged", "status": "completed", "tag": "410ca3cd-385e-464e-9409-2b05ac233c4f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:19.899948 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-19211c9b-72fb-426e-83e6-dc46de05c6c3 req-f05b6a60-dba2-4c1a-80a6-c78aa1d08f5d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:19.900679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-19211c9b-72fb-426e-83e6-dc46de05c6c3 req-f05b6a60-dba2-4c1a-80a6-c78aa1d08f5d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:19.922826 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-eae3385c-e292-45c8-ba00-699cd495881b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:19.928079 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-eae3385c-e292-45c8-ba00-699cd495881b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:19.947089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eae3385c-e292-45c8-ba00-699cd495881b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:19.947557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eae3385c-e292-45c8-ba00-699cd495881b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:19.948429 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eae3385c-e292-45c8-ba00-699cd495881b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:19.949154 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-19211c9b-72fb-426e-83e6-dc46de05c6c3 req-f05b6a60-dba2-4c1a-80a6-c78aa1d08f5d service nova] Creating event network-vif-plugged:410ca3cd-385e-464e-9409-2b05ac233c4f for instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d on hv-cinder-83697 Jul 25 16:25:19.949323 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-eae3385c-e292-45c8-ba00-699cd495881b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:19.962915 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-19211c9b-72fb-426e-83e6-dc46de05c6c3 req-f05b6a60-dba2-4c1a-80a6-c78aa1d08f5d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092331 Jul 25 16:25:19.964704 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 40/97] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:20.064205 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7b9f92e5-8ac6-47f2-9392-0fb50809c2de tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:20.065653 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7b9f92e5-8ac6-47f2-9392-0fb50809c2de tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:20.075308 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b9f92e5-8ac6-47f2-9392-0fb50809c2de tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:20.076215 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b9f92e5-8ac6-47f2-9392-0fb50809c2de tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:20.077813 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b9f92e5-8ac6-47f2-9392-0fb50809c2de tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:20.078651 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7b9f92e5-8ac6-47f2-9392-0fb50809c2de tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:20.266707 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-eae3385c-e292-45c8-ba00-699cd495881b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:20.316516 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-eae3385c-e292-45c8-ba00-699cd495881b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.399833 Jul 25 16:25:20.318528 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 58/98] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:19 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:20.380309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7b9f92e5-8ac6-47f2-9392-0fb50809c2de tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:20.397174 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7b9f92e5-8ac6-47f2-9392-0fb50809c2de tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.338758 Jul 25 16:25:20.398910 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 41/99] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:20 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:20.665836 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-182dd194-b92a-4620-92af-234459b28066 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:20.666906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-182dd194-b92a-4620-92af-234459b28066 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:20.674770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-182dd194-b92a-4620-92af-234459b28066 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:20.675461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-182dd194-b92a-4620-92af-234459b28066 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:20.676802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-182dd194-b92a-4620-92af-234459b28066 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:20.677566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-182dd194-b92a-4620-92af-234459b28066 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:20.937055 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-182dd194-b92a-4620-92af-234459b28066 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:20.949162 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-182dd194-b92a-4620-92af-234459b28066 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.289830 Jul 25 16:25:20.950267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 59/100] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:20 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:21.359035 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cddc0bc9-dcd5-415a-af03-3bcef95fd984 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:21.360496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cddc0bc9-dcd5-415a-af03-3bcef95fd984 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:21.391287 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddc0bc9-dcd5-415a-af03-3bcef95fd984 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:21.392101 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddc0bc9-dcd5-415a-af03-3bcef95fd984 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:21.393291 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddc0bc9-dcd5-415a-af03-3bcef95fd984 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:21.394804 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cddc0bc9-dcd5-415a-af03-3bcef95fd984 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:21.428265 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-90f3e80f-d800-41ac-960f-2d080ad88e37 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:21.433938 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-90f3e80f-d800-41ac-960f-2d080ad88e37 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:21.459421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90f3e80f-d800-41ac-960f-2d080ad88e37 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:21.461361 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90f3e80f-d800-41ac-960f-2d080ad88e37 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:21.463622 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90f3e80f-d800-41ac-960f-2d080ad88e37 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:21.464648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90f3e80f-d800-41ac-960f-2d080ad88e37 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:21.708298 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cddc0bc9-dcd5-415a-af03-3bcef95fd984 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:21.710723 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90f3e80f-d800-41ac-960f-2d080ad88e37 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:21.722759 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cddc0bc9-dcd5-415a-af03-3bcef95fd984 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.371652 Jul 25 16:25:21.723940 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 42/101] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:21 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:21.726130 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-90f3e80f-d800-41ac-960f-2d080ad88e37 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.305349 Jul 25 16:25:21.727463 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 60/102] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:21 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:21.990222 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-509897dd-9d1f-43c8-985b-da05e3189c31 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:21.991648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-509897dd-9d1f-43c8-985b-da05e3189c31 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:22.003138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-509897dd-9d1f-43c8-985b-da05e3189c31 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.004041 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-509897dd-9d1f-43c8-985b-da05e3189c31 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:22.005675 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-509897dd-9d1f-43c8-985b-da05e3189c31 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.006115 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-509897dd-9d1f-43c8-985b-da05e3189c31 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:22.249077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-509897dd-9d1f-43c8-985b-da05e3189c31 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:22.259845 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-509897dd-9d1f-43c8-985b-da05e3189c31 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.276933 Jul 25 16:25:22.260786 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 43/103] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:21 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:22.750834 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b554329a-2e30-4118-ac02-66e5194807eb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:22.751745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b554329a-2e30-4118-ac02-66e5194807eb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:22.763832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b554329a-2e30-4118-ac02-66e5194807eb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.765121 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b554329a-2e30-4118-ac02-66e5194807eb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:22.767158 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b554329a-2e30-4118-ac02-66e5194807eb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.768193 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b554329a-2e30-4118-ac02-66e5194807eb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:22.776045 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a58dbc80-6fe2-467c-81a8-287a13935105 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:22.777030 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a58dbc80-6fe2-467c-81a8-287a13935105 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:22.786161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a58dbc80-6fe2-467c-81a8-287a13935105 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.787154 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a58dbc80-6fe2-467c-81a8-287a13935105 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:22.788613 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a58dbc80-6fe2-467c-81a8-287a13935105 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:22.789189 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a58dbc80-6fe2-467c-81a8-287a13935105 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:23.093275 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b554329a-2e30-4118-ac02-66e5194807eb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:23.111641 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b554329a-2e30-4118-ac02-66e5194807eb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.367938 Jul 25 16:25:23.114012 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 61/104] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:22 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:23.170412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a58dbc80-6fe2-467c-81a8-287a13935105 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:23.185604 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a58dbc80-6fe2-467c-81a8-287a13935105 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.422475 Jul 25 16:25:23.187217 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 44/105] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:22 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:23.299638 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b068565b-2cef-40f3-8928-754eb7ca7d69 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:23.300760 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b068565b-2cef-40f3-8928-754eb7ca7d69 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:23.312014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b068565b-2cef-40f3-8928-754eb7ca7d69 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:23.312920 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b068565b-2cef-40f3-8928-754eb7ca7d69 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:23.314643 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b068565b-2cef-40f3-8928-754eb7ca7d69 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:23.315382 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b068565b-2cef-40f3-8928-754eb7ca7d69 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:23.768204 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b068565b-2cef-40f3-8928-754eb7ca7d69 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:23.782230 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b068565b-2cef-40f3-8928-754eb7ca7d69 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.491322 Jul 25 16:25:23.783273 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 62/106] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:23 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:24.149783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b4bc4fb9-eb8e-4600-b600-82272841726b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:24.150701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b4bc4fb9-eb8e-4600-b600-82272841726b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:24.159868 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4bc4fb9-eb8e-4600-b600-82272841726b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:24.160377 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4bc4fb9-eb8e-4600-b600-82272841726b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:24.161729 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4bc4fb9-eb8e-4600-b600-82272841726b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:24.162279 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4bc4fb9-eb8e-4600-b600-82272841726b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:24.235912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4ee49362-4740-4c78-9f44-388b8d3ad872 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:24.240069 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4ee49362-4740-4c78-9f44-388b8d3ad872 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:24.254705 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ee49362-4740-4c78-9f44-388b8d3ad872 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:24.255650 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ee49362-4740-4c78-9f44-388b8d3ad872 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:24.259470 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ee49362-4740-4c78-9f44-388b8d3ad872 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:24.260206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ee49362-4740-4c78-9f44-388b8d3ad872 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:24.468052 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4bc4fb9-eb8e-4600-b600-82272841726b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:24.504053 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b4bc4fb9-eb8e-4600-b600-82272841726b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.358779 Jul 25 16:25:24.506287 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 45/107] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:24 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:24.556704 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4ee49362-4740-4c78-9f44-388b8d3ad872 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:24.573094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4ee49362-4740-4c78-9f44-388b8d3ad872 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 0.347543 Jul 25 16:25:24.574079 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 63/108] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:24 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:24.818668 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c63f8507-e5f8-4201-9de3-1376b4fdbf47 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:24.819802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c63f8507-e5f8-4201-9de3-1376b4fdbf47 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:24.830954 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63f8507-e5f8-4201-9de3-1376b4fdbf47 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:24.831571 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63f8507-e5f8-4201-9de3-1376b4fdbf47 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:24.832862 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63f8507-e5f8-4201-9de3-1376b4fdbf47 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:24.833662 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c63f8507-e5f8-4201-9de3-1376b4fdbf47 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:25.073427 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c63f8507-e5f8-4201-9de3-1376b4fdbf47 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:25.087839 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c63f8507-e5f8-4201-9de3-1376b4fdbf47 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.276067 Jul 25 16:25:25.089040 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 46/109] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:24 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:25.546386 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f00a9e2e-6e8d-4ca4-9606-34636b5126c6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:25.549124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f00a9e2e-6e8d-4ca4-9606-34636b5126c6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:25.568224 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f00a9e2e-6e8d-4ca4-9606-34636b5126c6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:25.569928 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f00a9e2e-6e8d-4ca4-9606-34636b5126c6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:25.573637 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f00a9e2e-6e8d-4ca4-9606-34636b5126c6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:25.575091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f00a9e2e-6e8d-4ca4-9606-34636b5126c6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:25.638729 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e9f0f25f-1377-4d93-b691-1884914cdd21 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:25.641284 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e9f0f25f-1377-4d93-b691-1884914cdd21 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:25.652425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:25.698096 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9f0f25f-1377-4d93-b691-1884914cdd21 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:25.699932 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9f0f25f-1377-4d93-b691-1884914cdd21 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:25.705170 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9f0f25f-1377-4d93-b691-1884914cdd21 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:25.707332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e9f0f25f-1377-4d93-b691-1884914cdd21 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:26.587228 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f00a9e2e-6e8d-4ca4-9606-34636b5126c6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:26.623473 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f00a9e2e-6e8d-4ca4-9606-34636b5126c6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 1.083431 Jul 25 16:25:26.639032 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 64/110] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:25 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:26.664156 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-10a29aa0-21af-4bb6-9d63-47ebd07782b8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:26.664780 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-10a29aa0-21af-4bb6-9d63-47ebd07782b8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:26.703010 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10a29aa0-21af-4bb6-9d63-47ebd07782b8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:26.703460 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10a29aa0-21af-4bb6-9d63-47ebd07782b8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:26.706573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10a29aa0-21af-4bb6-9d63-47ebd07782b8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:26.710231 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-10a29aa0-21af-4bb6-9d63-47ebd07782b8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:26.772709 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e9f0f25f-1377-4d93-b691-1884914cdd21 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:26.787747 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e9f0f25f-1377-4d93-b691-1884914cdd21 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 1.184796 Jul 25 16:25:26.819359 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 47/111] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:25 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:27.395254 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-10a29aa0-21af-4bb6-9d63-47ebd07782b8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:27.424222 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-10a29aa0-21af-4bb6-9d63-47ebd07782b8 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.783428 Jul 25 16:25:27.426530 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 65/112] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:26 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:27.665795 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-37a11d22-afbb-4060-ba9e-e6845b6895e9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:27.671997 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-37a11d22-afbb-4060-ba9e-e6845b6895e9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:27.710711 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37a11d22-afbb-4060-ba9e-e6845b6895e9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:27.715022 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37a11d22-afbb-4060-ba9e-e6845b6895e9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:27.719934 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37a11d22-afbb-4060-ba9e-e6845b6895e9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:27.721833 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-37a11d22-afbb-4060-ba9e-e6845b6895e9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:27.841418 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cb31d42d-55a2-49cb-be62-6fd6064638ca tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:27.842562 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cb31d42d-55a2-49cb-be62-6fd6064638ca tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:27.863617 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb31d42d-55a2-49cb-be62-6fd6064638ca tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:27.864342 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb31d42d-55a2-49cb-be62-6fd6064638ca tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:27.866012 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb31d42d-55a2-49cb-be62-6fd6064638ca tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:27.874868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb31d42d-55a2-49cb-be62-6fd6064638ca tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:28.603650 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-37a11d22-afbb-4060-ba9e-e6845b6895e9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:28.630446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-37a11d22-afbb-4060-ba9e-e6845b6895e9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.978504 Jul 25 16:25:28.636285 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 48/113] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:27 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:28.663962 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3ed1eb22-aafc-4947-abaa-1d13a00fc007 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:28.666879 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3ed1eb22-aafc-4947-abaa-1d13a00fc007 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:28.688215 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ed1eb22-aafc-4947-abaa-1d13a00fc007 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:28.693292 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ed1eb22-aafc-4947-abaa-1d13a00fc007 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:28.696427 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ed1eb22-aafc-4947-abaa-1d13a00fc007 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:28.698511 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ed1eb22-aafc-4947-abaa-1d13a00fc007 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:28.891870 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cb31d42d-55a2-49cb-be62-6fd6064638ca tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:28.915430 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cb31d42d-55a2-49cb-be62-6fd6064638ca tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1313 microversion: 2.1 time: 1.081732 Jul 25 16:25:28.929386 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 66/114] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:27 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1313 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:29.013259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-b3d0c937-977d-4f11-9887-438081fc4e79 req-ad336085-7f35-4d32-8cf2-08c206fae98e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a766e06-b19b-4fd9-9f31-7ef4af533654", "name": "network-vif-plugged", "status": "completed", "tag": "1ea0fdf3-0f2b-440a-ac9c-39e48abc4a64"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:29.054243 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b3d0c937-977d-4f11-9887-438081fc4e79 req-ad336085-7f35-4d32-8cf2-08c206fae98e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:29.054976 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b3d0c937-977d-4f11-9887-438081fc4e79 req-ad336085-7f35-4d32-8cf2-08c206fae98e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:29.079399 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:29.106247 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-b3d0c937-977d-4f11-9887-438081fc4e79 req-ad336085-7f35-4d32-8cf2-08c206fae98e service nova] Creating event network-vif-plugged:1ea0fdf3-0f2b-440a-ac9c-39e48abc4a64 for instance 9a766e06-b19b-4fd9-9f31-7ef4af533654 on hv-cinder-83697 Jul 25 16:25:29.126871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-b3d0c937-977d-4f11-9887-438081fc4e79 req-ad336085-7f35-4d32-8cf2-08c206fae98e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119822 Jul 25 16:25:29.128631 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 67/115] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:25:29.159913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3ed1eb22-aafc-4947-abaa-1d13a00fc007 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:29.190827 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3ed1eb22-aafc-4947-abaa-1d13a00fc007 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.546251 Jul 25 16:25:29.192511 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 49/116] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:28 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:29.676123 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c3c785ac-0cd9-4fbf-b7ab-7b27ec175f34 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:29.677411 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c3c785ac-0cd9-4fbf-b7ab-7b27ec175f34 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:29.694771 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3c785ac-0cd9-4fbf-b7ab-7b27ec175f34 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:29.695500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3c785ac-0cd9-4fbf-b7ab-7b27ec175f34 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:29.697009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3c785ac-0cd9-4fbf-b7ab-7b27ec175f34 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:29.697591 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3c785ac-0cd9-4fbf-b7ab-7b27ec175f34 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:29.960797 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5602af0-698c-4f7b-8f80-19f456d41d90 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:29.964407 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f5602af0-698c-4f7b-8f80-19f456d41d90 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:29.977454 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5602af0-698c-4f7b-8f80-19f456d41d90 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:29.978538 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5602af0-698c-4f7b-8f80-19f456d41d90 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:29.980372 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5602af0-698c-4f7b-8f80-19f456d41d90 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:29.981096 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5602af0-698c-4f7b-8f80-19f456d41d90 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:30.182090 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c3c785ac-0cd9-4fbf-b7ab-7b27ec175f34 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:30.199100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c3c785ac-0cd9-4fbf-b7ab-7b27ec175f34 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.535931 Jul 25 16:25:30.201124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 68/117] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:29 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:30.222715 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e0e60ec3-544f-473a-88ca-79d4ff1e79df tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:30.224730 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e0e60ec3-544f-473a-88ca-79d4ff1e79df tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:30.237571 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e0e60ec3-544f-473a-88ca-79d4ff1e79df tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:30.238917 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e0e60ec3-544f-473a-88ca-79d4ff1e79df tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:30.241088 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e0e60ec3-544f-473a-88ca-79d4ff1e79df tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:30.242126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e0e60ec3-544f-473a-88ca-79d4ff1e79df tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:30.325150 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5602af0-698c-4f7b-8f80-19f456d41d90 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:30.348673 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f5602af0-698c-4f7b-8f80-19f456d41d90 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1500 microversion: 2.1 time: 0.394966 Jul 25 16:25:30.350080 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 50/118] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:29 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1500 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:30.504499 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e0e60ec3-544f-473a-88ca-79d4ff1e79df tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:30.518730 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e0e60ec3-544f-473a-88ca-79d4ff1e79df tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.305145 Jul 25 16:25:30.520069 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 69/119] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:30 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:31.255043 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21432f4b-ab32-454b-be4e-41fccd239d11 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:31.260134 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-21432f4b-ab32-454b-be4e-41fccd239d11 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:31.285553 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21432f4b-ab32-454b-be4e-41fccd239d11 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:31.288234 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21432f4b-ab32-454b-be4e-41fccd239d11 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:31.290806 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21432f4b-ab32-454b-be4e-41fccd239d11 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:31.295145 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21432f4b-ab32-454b-be4e-41fccd239d11 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:31.585327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f6cafdbd-3e0c-4c87-92d9-dec92a28e3f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:31.588515 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f6cafdbd-3e0c-4c87-92d9-dec92a28e3f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:31.596803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:31.620593 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6cafdbd-3e0c-4c87-92d9-dec92a28e3f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:31.621546 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6cafdbd-3e0c-4c87-92d9-dec92a28e3f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:31.623032 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6cafdbd-3e0c-4c87-92d9-dec92a28e3f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:31.624175 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6cafdbd-3e0c-4c87-92d9-dec92a28e3f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:31.660907 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-21432f4b-ab32-454b-be4e-41fccd239d11 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:31.676877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-21432f4b-ab32-454b-be4e-41fccd239d11 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.436469 Jul 25 16:25:31.678145 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 51/120] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:31 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:31.886153 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f6cafdbd-3e0c-4c87-92d9-dec92a28e3f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:31.901269 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f6cafdbd-3e0c-4c87-92d9-dec92a28e3f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.347703 Jul 25 16:25:31.902395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 70/121] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:31 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:32.357644 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-39cff531-2cec-45c3-8e13-a92b81d713e6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "499c5053-f6a1-49f6-98ec-ebe41a14f36b"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:32.373945 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-39cff531-2cec-45c3-8e13-a92b81d713e6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:32.406000 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39cff531-2cec-45c3-8e13-a92b81d713e6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:32.407801 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39cff531-2cec-45c3-8e13-a92b81d713e6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:32.415417 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39cff531-2cec-45c3-8e13-a92b81d713e6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:32.417069 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39cff531-2cec-45c3-8e13-a92b81d713e6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:32.755610 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3537a2b6-b9b6-4d02-86e3-7f1315776432 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:32.759030 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3537a2b6-b9b6-4d02-86e3-7f1315776432 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:32.795773 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3537a2b6-b9b6-4d02-86e3-7f1315776432 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:32.803850 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3537a2b6-b9b6-4d02-86e3-7f1315776432 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:32.805556 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3537a2b6-b9b6-4d02-86e3-7f1315776432 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:32.811507 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3537a2b6-b9b6-4d02-86e3-7f1315776432 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:33.339404 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3537a2b6-b9b6-4d02-86e3-7f1315776432 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:33.361251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3537a2b6-b9b6-4d02-86e3-7f1315776432 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.643488 Jul 25 16:25:33.367313 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 71/122] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:32 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:33.386810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e52be31a-30b2-4cbe-9dff-0d0e8175362b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:33.388131 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e52be31a-30b2-4cbe-9dff-0d0e8175362b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:33.404000 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e52be31a-30b2-4cbe-9dff-0d0e8175362b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:33.405098 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e52be31a-30b2-4cbe-9dff-0d0e8175362b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:33.406838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e52be31a-30b2-4cbe-9dff-0d0e8175362b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:33.408984 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e52be31a-30b2-4cbe-9dff-0d0e8175362b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:33.549615 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-39cff531-2cec-45c3-8e13-a92b81d713e6 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "POST /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.204902 Jul 25 16:25:33.553243 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 52/123] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:25:32 2022] POST /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d/os-volume_attachments => generated 194 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:33.907187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e52be31a-30b2-4cbe-9dff-0d0e8175362b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:33.922089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e52be31a-30b2-4cbe-9dff-0d0e8175362b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.552339 Jul 25 16:25:33.923393 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 72/124] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:33 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:34.405124 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ac8b1e41-3bd4-46ac-b999-c694f8e7e529 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:34.406936 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ac8b1e41-3bd4-46ac-b999-c694f8e7e529 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:34.418460 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac8b1e41-3bd4-46ac-b999-c694f8e7e529 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:34.419085 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac8b1e41-3bd4-46ac-b999-c694f8e7e529 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:34.420124 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac8b1e41-3bd4-46ac-b999-c694f8e7e529 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:34.420913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac8b1e41-3bd4-46ac-b999-c694f8e7e529 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:34.640381 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ac8b1e41-3bd4-46ac-b999-c694f8e7e529 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:34.653108 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ac8b1e41-3bd4-46ac-b999-c694f8e7e529 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.255095 Jul 25 16:25:34.670171 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 53/125] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:34 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:34.962830 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2472151b-f661-4564-85d2-8637f69ed55b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:34.964687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2472151b-f661-4564-85d2-8637f69ed55b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:34.974122 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2472151b-f661-4564-85d2-8637f69ed55b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:34.974871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2472151b-f661-4564-85d2-8637f69ed55b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:34.976201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2472151b-f661-4564-85d2-8637f69ed55b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:34.976984 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2472151b-f661-4564-85d2-8637f69ed55b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:35.230460 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2472151b-f661-4564-85d2-8637f69ed55b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:35.254315 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2472151b-f661-4564-85d2-8637f69ed55b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1322 microversion: 2.1 time: 0.300184 Jul 25 16:25:35.255037 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 73/126] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:34 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:35.687272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ea97527-d00c-4da0-8b54-ed6f1471bfe3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:35.688407 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ea97527-d00c-4da0-8b54-ed6f1471bfe3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:35.711494 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ea97527-d00c-4da0-8b54-ed6f1471bfe3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:35.712363 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ea97527-d00c-4da0-8b54-ed6f1471bfe3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:35.713904 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ea97527-d00c-4da0-8b54-ed6f1471bfe3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:35.714705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ea97527-d00c-4da0-8b54-ed6f1471bfe3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:36.119278 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ea97527-d00c-4da0-8b54-ed6f1471bfe3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:36.141317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ea97527-d00c-4da0-8b54-ed6f1471bfe3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.460581 Jul 25 16:25:36.154317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 54/127] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:35 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:36.281823 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-003c9ba9-2ffd-4852-aa07-304b77f7270d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:36.282628 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-003c9ba9-2ffd-4852-aa07-304b77f7270d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:36.290507 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-003c9ba9-2ffd-4852-aa07-304b77f7270d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:36.290971 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-003c9ba9-2ffd-4852-aa07-304b77f7270d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:36.292055 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-003c9ba9-2ffd-4852-aa07-304b77f7270d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:36.292511 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-003c9ba9-2ffd-4852-aa07-304b77f7270d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:36.508890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-003c9ba9-2ffd-4852-aa07-304b77f7270d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:36.523586 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-003c9ba9-2ffd-4852-aa07-304b77f7270d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1517 microversion: 2.1 time: 0.246105 Jul 25 16:25:36.525410 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 74/128] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:36 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1517 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:36.559662 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c04cb830-5f46-47e1-bc85-5a8ca61427ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:36.565871 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c04cb830-5f46-47e1-bc85-5a8ca61427ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:36.585261 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c04cb830-5f46-47e1-bc85-5a8ca61427ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:36.586557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c04cb830-5f46-47e1-bc85-5a8ca61427ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:36.588530 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c04cb830-5f46-47e1-bc85-5a8ca61427ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:36.589577 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c04cb830-5f46-47e1-bc85-5a8ca61427ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:36.657891 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-c04cb830-5f46-47e1-bc85-5a8ca61427ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lazy-loading 'flavor' on Instance uuid 9a766e06-b19b-4fd9-9f31-7ef4af533654 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:25:36.664839 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:36.987637 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c04cb830-5f46-47e1-bc85-5a8ca61427ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654/action" status: 200 len: 32 microversion: 2.1 time: 0.440895 Jul 25 16:25:36.989158 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 55/129] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:25:36 2022] POST /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654/action => generated 32 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:25:37.008553 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d4b6264e-c6a8-42db-805f-163c7c410f88 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:37.011166 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d4b6264e-c6a8-42db-805f-163c7c410f88 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:37.031188 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4b6264e-c6a8-42db-805f-163c7c410f88 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:37.033909 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4b6264e-c6a8-42db-805f-163c7c410f88 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:37.035799 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4b6264e-c6a8-42db-805f-163c7c410f88 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:37.037154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4b6264e-c6a8-42db-805f-163c7c410f88 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:37.196932 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-101c287f-4fb7-4c39-b60c-e2132f61207c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:37.198255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-101c287f-4fb7-4c39-b60c-e2132f61207c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:37.230232 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-101c287f-4fb7-4c39-b60c-e2132f61207c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:37.239036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-101c287f-4fb7-4c39-b60c-e2132f61207c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:37.246512 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-101c287f-4fb7-4c39-b60c-e2132f61207c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:37.250056 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-101c287f-4fb7-4c39-b60c-e2132f61207c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:37.690964 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d4b6264e-c6a8-42db-805f-163c7c410f88 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:37.704978 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d4b6264e-c6a8-42db-805f-163c7c410f88 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.707045 Jul 25 16:25:37.706503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 75/130] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:36 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:37.728651 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-101c287f-4fb7-4c39-b60c-e2132f61207c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:37.738522 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-101c287f-4fb7-4c39-b60c-e2132f61207c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.557907 Jul 25 16:25:37.739408 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 56/131] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:37 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:38.740995 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-14728f65-8c3f-4b5a-9150-85076d2f31a0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:38.742060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-14728f65-8c3f-4b5a-9150-85076d2f31a0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:38.754870 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14728f65-8c3f-4b5a-9150-85076d2f31a0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:38.755985 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14728f65-8c3f-4b5a-9150-85076d2f31a0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:38.757924 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14728f65-8c3f-4b5a-9150-85076d2f31a0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:38.758869 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14728f65-8c3f-4b5a-9150-85076d2f31a0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:38.776807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ded5444f-22d8-405e-a865-2c3d095eb74c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:38.781995 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ded5444f-22d8-405e-a865-2c3d095eb74c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:38.818044 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ded5444f-22d8-405e-a865-2c3d095eb74c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:38.820551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ded5444f-22d8-405e-a865-2c3d095eb74c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:38.825675 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ded5444f-22d8-405e-a865-2c3d095eb74c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:38.842534 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ded5444f-22d8-405e-a865-2c3d095eb74c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:39.435978 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-14728f65-8c3f-4b5a-9150-85076d2f31a0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:39.465705 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-14728f65-8c3f-4b5a-9150-85076d2f31a0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.729613 Jul 25 16:25:39.470857 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 76/132] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:38 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:39.621777 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ded5444f-22d8-405e-a865-2c3d095eb74c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:39.639414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ded5444f-22d8-405e-a865-2c3d095eb74c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.879196 Jul 25 16:25:39.640359 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 57/133] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:38 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:40.516347 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1198ae38-272c-49ab-b1bb-46993f1ca799 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:40.517848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1198ae38-272c-49ab-b1bb-46993f1ca799 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:40.533420 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1198ae38-272c-49ab-b1bb-46993f1ca799 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:40.534234 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1198ae38-272c-49ab-b1bb-46993f1ca799 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:40.536378 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1198ae38-272c-49ab-b1bb-46993f1ca799 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:40.537498 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1198ae38-272c-49ab-b1bb-46993f1ca799 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:40.685209 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b0206a16-4919-44e4-96a1-6d24a2e33688 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:40.704613 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b0206a16-4919-44e4-96a1-6d24a2e33688 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:40.748721 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0206a16-4919-44e4-96a1-6d24a2e33688 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:40.751170 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0206a16-4919-44e4-96a1-6d24a2e33688 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:40.763283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0206a16-4919-44e4-96a1-6d24a2e33688 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:40.768522 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0206a16-4919-44e4-96a1-6d24a2e33688 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:41.299307 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1198ae38-272c-49ab-b1bb-46993f1ca799 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:41.333241 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1198ae38-272c-49ab-b1bb-46993f1ca799 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.822314 Jul 25 16:25:41.351122 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 77/134] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:40 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:41.387454 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-4047087d-721b-4b9d-ac49-3bbe4f1e9093 req-3c9e60e1-1454-404f-8033-7c8fe35cd854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfffb541-3a46-4a3f-ad6c-8d7a88586b23", "name": "network-vif-plugged", "status": "completed", "tag": "aaea7be2-6388-4c1f-8fe7-40d03b69cf00"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:41.408466 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-4047087d-721b-4b9d-ac49-3bbe4f1e9093 req-3c9e60e1-1454-404f-8033-7c8fe35cd854 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:41.409527 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-4047087d-721b-4b9d-ac49-3bbe4f1e9093 req-3c9e60e1-1454-404f-8033-7c8fe35cd854 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:41.436330 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-4047087d-721b-4b9d-ac49-3bbe4f1e9093 req-3c9e60e1-1454-404f-8033-7c8fe35cd854 service nova] Creating event network-vif-plugged:aaea7be2-6388-4c1f-8fe7-40d03b69cf00 for instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 on hv-cinder-83697 Jul 25 16:25:41.456061 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-4047087d-721b-4b9d-ac49-3bbe4f1e9093 req-3c9e60e1-1454-404f-8033-7c8fe35cd854 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086712 Jul 25 16:25:41.458921 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 78/135] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:41.476679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b0206a16-4919-44e4-96a1-6d24a2e33688 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:41.503030 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b0206a16-4919-44e4-96a1-6d24a2e33688 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.830984 Jul 25 16:25:41.505379 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 58/136] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:40 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:42.384828 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a5f4a6f4-f5c3-4614-9f98-c1c6e931a6a1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:42.385987 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4c6cf3b-7eb9-426e-b863-1ff27034b127 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:42.386578 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a5f4a6f4-f5c3-4614-9f98-c1c6e931a6a1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:42.387136 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4c6cf3b-7eb9-426e-b863-1ff27034b127 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:42.402500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a5f4a6f4-f5c3-4614-9f98-c1c6e931a6a1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.404010 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a5f4a6f4-f5c3-4614-9f98-c1c6e931a6a1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.406263 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a5f4a6f4-f5c3-4614-9f98-c1c6e931a6a1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.407383 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a5f4a6f4-f5c3-4614-9f98-c1c6e931a6a1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.451263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4c6cf3b-7eb9-426e-b863-1ff27034b127 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.452277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4c6cf3b-7eb9-426e-b863-1ff27034b127 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.461562 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4c6cf3b-7eb9-426e-b863-1ff27034b127 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.464039 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4c6cf3b-7eb9-426e-b863-1ff27034b127 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.489545 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a5f4a6f4-f5c3-4614-9f98-c1c6e931a6a1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:25:42.928539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a5f4a6f4-f5c3-4614-9f98-c1c6e931a6a1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 204 len: 0 microversion: 2.1 time: 0.553969 Jul 25 16:25:42.930930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 79/137] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:25:42 2022] DELETE /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:25:42.944040 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-06ffebe9-44fe-4b06-a60e-83e5b2b45027 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:42.948153 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-06ffebe9-44fe-4b06-a60e-83e5b2b45027 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:42.963685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06ffebe9-44fe-4b06-a60e-83e5b2b45027 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.964554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06ffebe9-44fe-4b06-a60e-83e5b2b45027 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.968716 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06ffebe9-44fe-4b06-a60e-83e5b2b45027 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:42.970025 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06ffebe9-44fe-4b06-a60e-83e5b2b45027 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:42.986797 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d4c6cf3b-7eb9-426e-b863-1ff27034b127 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:43.015039 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4c6cf3b-7eb9-426e-b863-1ff27034b127 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.637911 Jul 25 16:25:43.027319 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 59/138] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:42 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:43.050595 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6be1cfaf-70bc-4c75-b654-13344ba99b0d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:43.055141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6be1cfaf-70bc-4c75-b654-13344ba99b0d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:43.081503 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6be1cfaf-70bc-4c75-b654-13344ba99b0d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:43.083153 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6be1cfaf-70bc-4c75-b654-13344ba99b0d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:43.086282 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6be1cfaf-70bc-4c75-b654-13344ba99b0d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:43.087227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6be1cfaf-70bc-4c75-b654-13344ba99b0d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:43.456530 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-06ffebe9-44fe-4b06-a60e-83e5b2b45027 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:43.493856 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-06ffebe9-44fe-4b06-a60e-83e5b2b45027 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.557823 Jul 25 16:25:43.499224 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 80/139] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:42 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:43.574814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6be1cfaf-70bc-4c75-b654-13344ba99b0d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:43.598814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6be1cfaf-70bc-4c75-b654-13344ba99b0d tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1552 microversion: 2.1 time: 0.569762 Jul 25 16:25:43.600127 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 60/140] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:43 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1552 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:44.071265 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a517b292-255a-4b90-a1fa-186e897d7d39 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:44.100815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a517b292-255a-4b90-a1fa-186e897d7d39 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:44.145128 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a517b292-255a-4b90-a1fa-186e897d7d39 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.154326 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a517b292-255a-4b90-a1fa-186e897d7d39 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.161645 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a517b292-255a-4b90-a1fa-186e897d7d39 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.163094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a517b292-255a-4b90-a1fa-186e897d7d39 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.540753 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-42a396ca-7aef-47d3-a91b-9d931839ba7b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:44.541793 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-42a396ca-7aef-47d3-a91b-9d931839ba7b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:44.555648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a396ca-7aef-47d3-a91b-9d931839ba7b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.556440 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a396ca-7aef-47d3-a91b-9d931839ba7b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.558029 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a396ca-7aef-47d3-a91b-9d931839ba7b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.558557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-42a396ca-7aef-47d3-a91b-9d931839ba7b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.911949 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a517b292-255a-4b90-a1fa-186e897d7d39 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:44.936071 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a517b292-255a-4b90-a1fa-186e897d7d39 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.872530 Jul 25 16:25:44.949408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 81/141] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:44 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:44.949408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a1c4184-b7a5-4eae-a181-608ef9a57d54 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:44.950801 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4a1c4184-b7a5-4eae-a181-608ef9a57d54 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:44.964722 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a1c4184-b7a5-4eae-a181-608ef9a57d54 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.967691 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a1c4184-b7a5-4eae-a181-608ef9a57d54 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:44.970912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a1c4184-b7a5-4eae-a181-608ef9a57d54 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:44.972988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a1c4184-b7a5-4eae-a181-608ef9a57d54 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:45.271604 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-42a396ca-7aef-47d3-a91b-9d931839ba7b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:45.312720 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-42a396ca-7aef-47d3-a91b-9d931839ba7b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.778161 Jul 25 16:25:45.338475 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 61/142] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:44 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:45.448940 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4a1c4184-b7a5-4eae-a181-608ef9a57d54 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:45.470783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4a1c4184-b7a5-4eae-a181-608ef9a57d54 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1552 microversion: 2.1 time: 0.530288 Jul 25 16:25:45.472277 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 82/143] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:44 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1552 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:45.997148 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eb4f643a-9bee-4a02-b47d-821037e927cc tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:45.999397 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eb4f643a-9bee-4a02-b47d-821037e927cc tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:46.016738 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb4f643a-9bee-4a02-b47d-821037e927cc tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.018322 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb4f643a-9bee-4a02-b47d-821037e927cc tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.020139 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb4f643a-9bee-4a02-b47d-821037e927cc tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.021536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eb4f643a-9bee-4a02-b47d-821037e927cc tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.380062 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4c8f6cff-d1cb-4382-8d62-b4f90ace1f2b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:46.381368 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4c8f6cff-d1cb-4382-8d62-b4f90ace1f2b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:46.396591 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c8f6cff-d1cb-4382-8d62-b4f90ace1f2b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.397291 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c8f6cff-d1cb-4382-8d62-b4f90ace1f2b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.398356 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eb4f643a-9bee-4a02-b47d-821037e927cc tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:46.403987 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c8f6cff-d1cb-4382-8d62-b4f90ace1f2b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.404343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c8f6cff-d1cb-4382-8d62-b4f90ace1f2b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.422993 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eb4f643a-9bee-4a02-b47d-821037e927cc tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.438024 Jul 25 16:25:46.423967 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 62/144] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:45 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:46.439546 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:46.511484 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65adc450-7797-4bb6-b06e-8bb21e4f5bb3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:46.518614 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65adc450-7797-4bb6-b06e-8bb21e4f5bb3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:46.542229 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65adc450-7797-4bb6-b06e-8bb21e4f5bb3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.544832 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65adc450-7797-4bb6-b06e-8bb21e4f5bb3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.550314 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65adc450-7797-4bb6-b06e-8bb21e4f5bb3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:46.551664 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65adc450-7797-4bb6-b06e-8bb21e4f5bb3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:46.718368 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4c8f6cff-d1cb-4382-8d62-b4f90ace1f2b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:46.734984 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4c8f6cff-d1cb-4382-8d62-b4f90ace1f2b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.361760 Jul 25 16:25:46.736411 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 83/145] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:46 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:46.950043 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-65adc450-7797-4bb6-b06e-8bb21e4f5bb3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:46.969782 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65adc450-7797-4bb6-b06e-8bb21e4f5bb3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1552 microversion: 2.1 time: 0.469283 Jul 25 16:25:46.984072 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 63/146] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:46 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1552 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:47.463522 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-70fa76dc-b159-44d9-853b-8c282a8af2f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:47.467272 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-70fa76dc-b159-44d9-853b-8c282a8af2f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:47.492057 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70fa76dc-b159-44d9-853b-8c282a8af2f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:47.492863 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70fa76dc-b159-44d9-853b-8c282a8af2f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:47.495265 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70fa76dc-b159-44d9-853b-8c282a8af2f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:47.496230 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70fa76dc-b159-44d9-853b-8c282a8af2f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:47.786025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f32a879a-5153-4fad-b4d8-0d540389e5f9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:47.788383 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f32a879a-5153-4fad-b4d8-0d540389e5f9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:47.806350 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f32a879a-5153-4fad-b4d8-0d540389e5f9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:47.807507 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f32a879a-5153-4fad-b4d8-0d540389e5f9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:47.810845 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f32a879a-5153-4fad-b4d8-0d540389e5f9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:47.812053 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f32a879a-5153-4fad-b4d8-0d540389e5f9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:47.947784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-70fa76dc-b159-44d9-853b-8c282a8af2f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:47.968455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-70fa76dc-b159-44d9-853b-8c282a8af2f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.510788 Jul 25 16:25:47.970099 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 84/147] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:47 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:48.018391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e53a76d0-be8c-4720-bf05-d77e269cb0e1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:48.021630 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e53a76d0-be8c-4720-bf05-d77e269cb0e1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:48.034120 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e53a76d0-be8c-4720-bf05-d77e269cb0e1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:48.035282 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e53a76d0-be8c-4720-bf05-d77e269cb0e1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:48.036962 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e53a76d0-be8c-4720-bf05-d77e269cb0e1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:48.039534 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e53a76d0-be8c-4720-bf05-d77e269cb0e1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:48.257079 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f32a879a-5153-4fad-b4d8-0d540389e5f9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:48.294832 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f32a879a-5153-4fad-b4d8-0d540389e5f9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1363 microversion: 2.1 time: 0.527488 Jul 25 16:25:48.296261 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 64/148] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:47 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1363 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:48.367866 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e53a76d0-be8c-4720-bf05-d77e269cb0e1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:48.378601 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e53a76d0-be8c-4720-bf05-d77e269cb0e1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1552 microversion: 2.1 time: 0.370330 Jul 25 16:25:48.394546 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 85/149] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:48 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1552 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:48.664345 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1236067562", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "networks": [{"uuid": "0410d071-03f1-4e3a-a75f-6200cc3088da"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:48.753927 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] validate_networks() for [('0410d071-03f1-4e3a-a75f-6200cc3088da', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:25:48.998333 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3d72c0b2-9c14-46b5-971c-6bfbf0e564b1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:48.999226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3d72c0b2-9c14-46b5-971c-6bfbf0e564b1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:49.012218 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d72c0b2-9c14-46b5-971c-6bfbf0e564b1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:49.013029 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d72c0b2-9c14-46b5-971c-6bfbf0e564b1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:49.015413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d72c0b2-9c14-46b5-971c-6bfbf0e564b1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:49.017089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d72c0b2-9c14-46b5-971c-6bfbf0e564b1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:49.679775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3d72c0b2-9c14-46b5-971c-6bfbf0e564b1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:49.721818 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3d72c0b2-9c14-46b5-971c-6bfbf0e564b1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.729203 Jul 25 16:25:49.737320 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 86/150] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:48 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:49.757765 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8387a34d-f3c0-44fd-a450-1dae193e307a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:49.767414 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8387a34d-f3c0-44fd-a450-1dae193e307a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:49.786852 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8387a34d-f3c0-44fd-a450-1dae193e307a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:49.787795 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8387a34d-f3c0-44fd-a450-1dae193e307a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:49.789856 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8387a34d-f3c0-44fd-a450-1dae193e307a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:49.792031 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8387a34d-f3c0-44fd-a450-1dae193e307a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.410551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:25:50.412410 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:25:50.413768 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:25:50.414742 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:25:50.415653 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:25:50.437176 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.439088 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.450935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.452335 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.471477 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8387a34d-f3c0-44fd-a450-1dae193e307a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:50.493917 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Getting quotas for project 1b1fba96612b4ed0ae53b43cdd4e3528. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:25:50.504407 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Getting quotas for user bb3927ae30c54149974d3037c1022854 and project 1b1fba96612b4ed0ae53b43cdd4e3528. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:25:50.507384 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8387a34d-f3c0-44fd-a450-1dae193e307a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1548 microversion: 2.1 time: 0.767738 Jul 25 16:25:50.508494 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 87/151] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:49 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1548 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:50.527526 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:50.528898 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:50.533453 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:25:50.539713 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:25:50.555320 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.556117 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.557601 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.558386 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.674045 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.675337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.676400 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lazy-loading 'fault' on Instance uuid d5b45fcf-8fc0-4e1a-9257-81beff81ee3d {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:25:50.765312 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d2b40a13-0094-4e4d-bdd8-3eda963c0548 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.107919 Jul 25 16:25:50.769831 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 65/152] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:25:50.789298 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d0f7e3f1cc4955a0ca99d588344322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287b6d7980174314b20fe6b172725bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:50.790537 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-bdf48e9b-634c-4cec-a1c5-0e746a9eb6c5 req-518ed397-a1b9-4438-bca3-7a828cb6fb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b45fcf-8fc0-4e1a-9257-81beff81ee3d", "name": "network-vif-deleted", "tag": "410ca3cd-385e-464e-9409-2b05ac233c4f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:50.808050 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-af2315ec-41a5-4625-babe-695e1bb24da1 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 200 len: 1349 microversion: 2.1 time: 0.289687 Jul 25 16:25:50.809741 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 88/153] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:50 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 1349 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:50.828055 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bdf48e9b-634c-4cec-a1c5-0e746a9eb6c5 req-518ed397-a1b9-4438-bca3-7a828cb6fb13 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.829205 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bdf48e9b-634c-4cec-a1c5-0e746a9eb6c5 req-518ed397-a1b9-4438-bca3-7a828cb6fb13 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.836190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ef638398-938f-4ac5-ade8-852d62a66576 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:50.837091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ef638398-938f-4ac5-ade8-852d62a66576 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:50.857114 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef638398-938f-4ac5-ade8-852d62a66576 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.857976 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef638398-938f-4ac5-ade8-852d62a66576 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.866611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef638398-938f-4ac5-ade8-852d62a66576 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.867580 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ef638398-938f-4ac5-ade8-852d62a66576 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.875209 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-bdf48e9b-634c-4cec-a1c5-0e746a9eb6c5 req-518ed397-a1b9-4438-bca3-7a828cb6fb13 service nova] Creating event network-vif-deleted:410ca3cd-385e-464e-9409-2b05ac233c4f for instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d on hv-cinder-83697 Jul 25 16:25:50.896943 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-bdf48e9b-634c-4cec-a1c5-0e746a9eb6c5 req-518ed397-a1b9-4438-bca3-7a828cb6fb13 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124030 Jul 25 16:25:50.898470 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 66/154] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:50.922346 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0627040a-f885-4835-a592-a15728be1f5b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:50.930104 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0627040a-f885-4835-a592-a15728be1f5b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:50.957522 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0627040a-f885-4835-a592-a15728be1f5b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.958897 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0627040a-f885-4835-a592-a15728be1f5b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:50.960331 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0627040a-f885-4835-a592-a15728be1f5b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:50.961065 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0627040a-f885-4835-a592-a15728be1f5b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:51.106787 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ef638398-938f-4ac5-ade8-852d62a66576 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.294112 Jul 25 16:25:51.108601 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 89/155] 10.222.0.66 () {58 vars in 1275 bytes} [Mon Jul 25 16:25:50 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/os-interface => generated 285 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:25:51.149853 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1dc712de-1762-4e81-b7a7-746c6e74f215 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:51.154725 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1dc712de-1762-4e81-b7a7-746c6e74f215 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:51.534934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1dc712de-1762-4e81-b7a7-746c6e74f215 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:51.554215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1dc712de-1762-4e81-b7a7-746c6e74f215 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1214 microversion: 2.1 time: 0.442589 Jul 25 16:25:51.554215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 90/156] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:51 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1214 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:51.654103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0627040a-f885-4835-a592-a15728be1f5b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:51.665695 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0627040a-f885-4835-a592-a15728be1f5b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.764070 Jul 25 16:25:51.667514 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 67/157] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:50 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:51.833709 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:51.834413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:51.848754 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:51.849377 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:51.851487 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:51.852188 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:51.882503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] HTTP exception thrown: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Request method failure captured: Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d HTTP/1.1 Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sO9PVrb7AR_0DCaYd8vp6eDv7RM6Au3cLsRykJ0uFSVCD5nQpadDPcm4zW9CgSTWq7OMVxxEuQzkW9eZOGh5viXQfdpBylvu0tFvvH9ZeOb5FoKvvl7Tx4JgoimyzEZyXiyP_Xu0QRUo1j9YGiqIPqeCAq8u5W7_k3ETtHq2bV0d6I Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 287b6d7980174314b20fe6b172725bf4 Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:25:51.899080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_287b6d7980174314b20fe6b172725bf4"}]}] Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 287b6d7980174314b20fe6b172725bf4 Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-DeleteServersTestJSON-1551483112-project Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: f2d0f7e3f1cc4955a0ca99d588344322 Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-DeleteServersTestJSON-1551483112-project Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:51.900455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'd5b45fcf-8fc0-4e1a-9257-81beff81ee3d'} Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:25:51.901154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:51.902284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:51.909887 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Returning 404 to user: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:25:51.912676 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d5d15121-7666-4a46-ba44-94d060adaac3 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 404 len: 111 microversion: 2.1 time: 0.083226 Jul 25 16:25:51.936091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 91/158] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:51 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:25:52.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:52.142015 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:52.158083 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:52.163547 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.164819 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:52.168439 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.204915 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] HTTP exception thrown: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Request method failure captured: Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d/os-volume_attachments HTTP/1.1 Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sO9PVrb7AR_0DCaYd8vp6eDv7RM6Au3cLsRykJ0uFSVCD5nQpadDPcm4zW9CgSTWq7OMVxxEuQzkW9eZOGh5viXQfdpBylvu0tFvvH9ZeOb5FoKvvl7Tx4JgoimyzEZyXiyP_Xu0QRUo1j9YGiqIPqeCAq8u5W7_k3ETtHq2bV0d6I Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 287b6d7980174314b20fe6b172725bf4 Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:25:52.220701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_287b6d7980174314b20fe6b172725bf4"}]}] Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 287b6d7980174314b20fe6b172725bf4 Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1551483112-project Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: f2d0f7e3f1cc4955a0ca99d588344322 Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1551483112-project Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:52.222263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'server_id': 'd5b45fcf-8fc0-4e1a-9257-81beff81ee3d'} Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:25:52.223054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:52.224227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:52.228024 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Returning 404 to user: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:25:52.228901 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fa0dbbcd-05c8-473a-8377-7ed15f05817b tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.094649 Jul 25 16:25:52.251758 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 68/159] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:25:52 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d/os-volume_attachments => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:25:52.578856 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1eabcecb-d450-46e5-855a-776e8ebaac56 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:52.580525 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1eabcecb-d450-46e5-855a-776e8ebaac56 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:52.592022 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1eabcecb-d450-46e5-855a-776e8ebaac56 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:52.593013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1eabcecb-d450-46e5-855a-776e8ebaac56 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.594118 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1eabcecb-d450-46e5-855a-776e8ebaac56 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:52.594723 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1eabcecb-d450-46e5-855a-776e8ebaac56 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.702773 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4cff2f9-92cf-48d6-bb96-52883b574c2c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:52.703839 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4cff2f9-92cf-48d6-bb96-52883b574c2c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:52.738900 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4cff2f9-92cf-48d6-bb96-52883b574c2c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:52.739654 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4cff2f9-92cf-48d6-bb96-52883b574c2c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.751181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4cff2f9-92cf-48d6-bb96-52883b574c2c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:52.751929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4cff2f9-92cf-48d6-bb96-52883b574c2c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:52.922819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1eabcecb-d450-46e5-855a-776e8ebaac56 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:52.936457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1eabcecb-d450-46e5-855a-776e8ebaac56 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1210 microversion: 2.1 time: 0.362244 Jul 25 16:25:52.938346 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 92/160] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:52 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1210 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:53.298161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d4cff2f9-92cf-48d6-bb96-52883b574c2c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:53.326865 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4cff2f9-92cf-48d6-bb96-52883b574c2c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.630153 Jul 25 16:25:53.327908 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 69/161] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:52 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:53.780894 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:53.784510 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:53.812679 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:53.815937 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:53.820179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:53.825164 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:53.866801 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] HTTP exception thrown: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Request method failure captured: Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d HTTP/1.1 Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sO9PVrb7AR_0DCaYd8vp6eDv7RM6Au3cLsRykJ0uFSVCD5nQpadDPcm4zW9CgSTWq7OMVxxEuQzkW9eZOGh5viXQfdpBylvu0tFvvH9ZeOb5FoKvvl7Tx4JgoimyzEZyXiyP_Xu0QRUo1j9YGiqIPqeCAq8u5W7_k3ETtHq2bV0d6I Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 287b6d7980174314b20fe6b172725bf4 Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:25:53.870184 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_287b6d7980174314b20fe6b172725bf4"}]}] Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 287b6d7980174314b20fe6b172725bf4 Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-DeleteServersTestJSON-1551483112-project Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: f2d0f7e3f1cc4955a0ca99d588344322 Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-DeleteServersTestJSON-1551483112-project Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.873215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'd5b45fcf-8fc0-4e1a-9257-81beff81ee3d'} Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:25:53.875198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.879930 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.886140 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Returning 404 to user: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:25:53.888121 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4fcd41fc-d194-4ac2-8a91-69976875aa64 tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 404 len: 111 microversion: 2.1 time: 0.114293 Jul 25 16:25:53.889972 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 93/162] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:25:53 2022] DELETE /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:25:53.904757 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:53.907141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] [instance: d5b45fcf-8fc0-4e1a-9257-81beff81ee3d] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:53.923140 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:53.925093 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:53.926946 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:53.928194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:53.959183 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] HTTP exception thrown: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Request method failure captured: Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d HTTP/1.1 Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sO9PVrb7AR_0DCaYd8vp6eDv7RM6Au3cLsRykJ0uFSVCD5nQpadDPcm4zW9CgSTWq7OMVxxEuQzkW9eZOGh5viXQfdpBylvu0tFvvH9ZeOb5FoKvvl7Tx4JgoimyzEZyXiyP_Xu0QRUo1j9YGiqIPqeCAq8u5W7_k3ETtHq2bV0d6I Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 287b6d7980174314b20fe6b172725bf4 Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:25:53.963496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/287b6d7980174314b20fe6b172725bf4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_287b6d7980174314b20fe6b172725bf4"}]}] Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 287b6d7980174314b20fe6b172725bf4 Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-DeleteServersTestJSON-1551483112 Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-DeleteServersTestJSON-1551483112-project Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: f2d0f7e3f1cc4955a0ca99d588344322 Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-DeleteServersTestJSON-1551483112-project Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.966317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'd5b45fcf-8fc0-4e1a-9257-81beff81ee3d'} Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:25:53.968023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. Jul 25 16:25:53.970301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:25:53.972266 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] Returning 404 to user: Instance d5b45fcf-8fc0-4e1a-9257-81beff81ee3d could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:25:53.972266 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b6d76cda-2fbf-4bde-8478-9cbe4b65683c tempest-DeleteServersTestJSON-1551483112 tempest-DeleteServersTestJSON-1551483112-project] 10.222.0.66 "GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d" status: 404 len: 111 microversion: 2.1 time: 0.070034 Jul 25 16:25:53.972266 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 70/163] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:53 2022] GET /compute/v2.1/servers/d5b45fcf-8fc0-4e1a-9257-81beff81ee3d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:25:53.984905 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b29033cd-728d-4897-a549-d1a511497f0a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:53.986332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b29033cd-728d-4897-a549-d1a511497f0a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:54.000324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29033cd-728d-4897-a549-d1a511497f0a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:54.001669 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29033cd-728d-4897-a549-d1a511497f0a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:54.004324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29033cd-728d-4897-a549-d1a511497f0a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:54.005479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b29033cd-728d-4897-a549-d1a511497f0a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:54.213172 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b29033cd-728d-4897-a549-d1a511497f0a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:54.247093 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b29033cd-728d-4897-a549-d1a511497f0a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1272 microversion: 2.1 time: 0.269068 Jul 25 16:25:54.250279 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 94/164] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:53 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:54.367829 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-430c3e35-2096-4818-8705-a950a65af279 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:54.371982 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-430c3e35-2096-4818-8705-a950a65af279 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:54.408695 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-430c3e35-2096-4818-8705-a950a65af279 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:54.409911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-430c3e35-2096-4818-8705-a950a65af279 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:54.413589 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-430c3e35-2096-4818-8705-a950a65af279 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:54.414638 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-430c3e35-2096-4818-8705-a950a65af279 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:54.774418 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-97bb60b4-b577-46a5-b78a-2b39c883b69a req-b2f3533b-7ce6-4d4c-8898-c650b410537d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfffb541-3a46-4a3f-ad6c-8d7a88586b23", "tag": "aaea7be2-6388-4c1f-8fe7-40d03b69cf00"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:25:54.821479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-97bb60b4-b577-46a5-b78a-2b39c883b69a req-b2f3533b-7ce6-4d4c-8898-c650b410537d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:54.836127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-97bb60b4-b577-46a5-b78a-2b39c883b69a req-b2f3533b-7ce6-4d4c-8898-c650b410537d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:54.913230 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-97bb60b4-b577-46a5-b78a-2b39c883b69a req-b2f3533b-7ce6-4d4c-8898-c650b410537d service nova] Creating event network-changed:aaea7be2-6388-4c1f-8fe7-40d03b69cf00 for instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 on hv-cinder-83697 Jul 25 16:25:54.948336 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-97bb60b4-b577-46a5-b78a-2b39c883b69a req-b2f3533b-7ce6-4d4c-8898-c650b410537d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178758 Jul 25 16:25:54.949444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 95/165] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:25:55.040840 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-430c3e35-2096-4818-8705-a950a65af279 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:55.069717 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-430c3e35-2096-4818-8705-a950a65af279 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.706295 Jul 25 16:25:55.071290 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 71/166] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:54 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:55.281848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f6a89a21-eeb0-474d-9c54-352b8bf28a62 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:55.284777 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f6a89a21-eeb0-474d-9c54-352b8bf28a62 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:55.305180 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a89a21-eeb0-474d-9c54-352b8bf28a62 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:55.306278 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a89a21-eeb0-474d-9c54-352b8bf28a62 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:55.307393 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a89a21-eeb0-474d-9c54-352b8bf28a62 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:55.307911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f6a89a21-eeb0-474d-9c54-352b8bf28a62 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:55.452217 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f6a89a21-eeb0-474d-9c54-352b8bf28a62 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:55.474178 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f6a89a21-eeb0-474d-9c54-352b8bf28a62 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1272 microversion: 2.1 time: 0.197489 Jul 25 16:25:55.475101 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 96/167] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:55 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:56.103232 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-39fa5a1f-6a1a-4e0c-8d02-a4acb5ec661c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:56.104785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-39fa5a1f-6a1a-4e0c-8d02-a4acb5ec661c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:56.121438 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:56.124344 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39fa5a1f-6a1a-4e0c-8d02-a4acb5ec661c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.125073 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39fa5a1f-6a1a-4e0c-8d02-a4acb5ec661c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.135452 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39fa5a1f-6a1a-4e0c-8d02-a4acb5ec661c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.136112 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-39fa5a1f-6a1a-4e0c-8d02-a4acb5ec661c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.504472 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-35fa0e68-7ab2-4c12-89d0-732c2caedee6 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:56.512694 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-35fa0e68-7ab2-4c12-89d0-732c2caedee6 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:56.530305 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-39fa5a1f-6a1a-4e0c-8d02-a4acb5ec661c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:56.547342 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35fa0e68-7ab2-4c12-89d0-732c2caedee6 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.553583 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-39fa5a1f-6a1a-4e0c-8d02-a4acb5ec661c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.453600 Jul 25 16:25:56.559056 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 72/168] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:56 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:56.587379 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35fa0e68-7ab2-4c12-89d0-732c2caedee6 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:56.599171 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35fa0e68-7ab2-4c12-89d0-732c2caedee6 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:56.600554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35fa0e68-7ab2-4c12-89d0-732c2caedee6 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:57.019900 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-35fa0e68-7ab2-4c12-89d0-732c2caedee6 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:57.032898 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-35fa0e68-7ab2-4c12-89d0-732c2caedee6 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.539001 Jul 25 16:25:57.053240 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 97/169] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:56 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:25:57.599439 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c351b9ed-d296-400e-b5b9-3c63d747c7ca tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:57.603246 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c351b9ed-d296-400e-b5b9-3c63d747c7ca tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:57.632419 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c351b9ed-d296-400e-b5b9-3c63d747c7ca tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:57.633184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c351b9ed-d296-400e-b5b9-3c63d747c7ca tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:57.639371 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c351b9ed-d296-400e-b5b9-3c63d747c7ca tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:57.640378 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c351b9ed-d296-400e-b5b9-3c63d747c7ca tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:57.648057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:25:58.056413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9a68155c-8312-4225-af82-ccce61d420be tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:58.057728 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9a68155c-8312-4225-af82-ccce61d420be tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:58.081256 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a68155c-8312-4225-af82-ccce61d420be tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:58.086077 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a68155c-8312-4225-af82-ccce61d420be tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:58.087042 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a68155c-8312-4225-af82-ccce61d420be tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:58.087569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9a68155c-8312-4225-af82-ccce61d420be tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:58.153078 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c351b9ed-d296-400e-b5b9-3c63d747c7ca tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:58.163072 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c351b9ed-d296-400e-b5b9-3c63d747c7ca tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.575191 Jul 25 16:25:58.170969 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 73/170] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:57 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:58.562733 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9a68155c-8312-4225-af82-ccce61d420be tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:58.576121 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9a68155c-8312-4225-af82-ccce61d420be tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.524050 Jul 25 16:25:58.581314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 98/171] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:58 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:59.210251 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-05fe1ea6-7ade-4eab-8be9-42428f14c1a3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:59.212830 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-05fe1ea6-7ade-4eab-8be9-42428f14c1a3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:59.227352 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05fe1ea6-7ade-4eab-8be9-42428f14c1a3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:59.229505 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05fe1ea6-7ade-4eab-8be9-42428f14c1a3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:59.232182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05fe1ea6-7ade-4eab-8be9-42428f14c1a3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:59.233763 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05fe1ea6-7ade-4eab-8be9-42428f14c1a3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:59.571646 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-05fe1ea6-7ade-4eab-8be9-42428f14c1a3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:25:59.588559 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-05fe1ea6-7ade-4eab-8be9-42428f14c1a3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.391640 Jul 25 16:25:59.611251 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 74/172] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:59 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:25:59.621411 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-193f0cc1-35fa-4c3a-afa6-8d4faf62d2b2 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:25:59.622392 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-193f0cc1-35fa-4c3a-afa6-8d4faf62d2b2 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:25:59.650839 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-193f0cc1-35fa-4c3a-afa6-8d4faf62d2b2 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:59.652396 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-193f0cc1-35fa-4c3a-afa6-8d4faf62d2b2 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:59.654230 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-193f0cc1-35fa-4c3a-afa6-8d4faf62d2b2 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:25:59.655341 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-193f0cc1-35fa-4c3a-afa6-8d4faf62d2b2 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:25:59.993267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-193f0cc1-35fa-4c3a-afa6-8d4faf62d2b2 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:00.022947 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-193f0cc1-35fa-4c3a-afa6-8d4faf62d2b2 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.406730 Jul 25 16:26:00.038574 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 99/173] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:25:59 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:00.632199 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-cf9f8b4a-10cc-40ba-8cd0-059238230dc7 req-d4203bfd-ad25-43c9-85cf-f561c52151f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93412ce8-1fdb-44e3-b22b-37a7128e8beb", "tag": "84fcc185-716f-4766-9f03-7fdf34e835c0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:00.661941 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-cf9f8b4a-10cc-40ba-8cd0-059238230dc7 req-d4203bfd-ad25-43c9-85cf-f561c52151f2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:00.662563 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eecc7dea-9be9-46ae-8acc-a90774c37241 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:00.663434 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-cf9f8b4a-10cc-40ba-8cd0-059238230dc7 req-d4203bfd-ad25-43c9-85cf-f561c52151f2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:00.663626 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eecc7dea-9be9-46ae-8acc-a90774c37241 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:00.663626 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:00.663626 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:00.703596 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-cf9f8b4a-10cc-40ba-8cd0-059238230dc7 req-d4203bfd-ad25-43c9-85cf-f561c52151f2 service nova] Creating event network-changed:84fcc185-716f-4766-9f03-7fdf34e835c0 for instance 93412ce8-1fdb-44e3-b22b-37a7128e8beb on hv-cinder-83697 Jul 25 16:26:00.708106 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecc7dea-9be9-46ae-8acc-a90774c37241 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:00.710093 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecc7dea-9be9-46ae-8acc-a90774c37241 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:00.713923 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecc7dea-9be9-46ae-8acc-a90774c37241 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:00.716529 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eecc7dea-9be9-46ae-8acc-a90774c37241 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:00.725994 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-cf9f8b4a-10cc-40ba-8cd0-059238230dc7 req-d4203bfd-ad25-43c9-85cf-f561c52151f2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097581 Jul 25 16:26:00.735640 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 100/174] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:01.031134 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eecc7dea-9be9-46ae-8acc-a90774c37241 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:01.053263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eecc7dea-9be9-46ae-8acc-a90774c37241 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.429736 Jul 25 16:26:01.065165 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 75/175] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:00 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:01.067465 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-286870d4-0663-450a-a2ab-791dcbaf9f26 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:01.070401 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-286870d4-0663-450a-a2ab-791dcbaf9f26 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:01.099515 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-286870d4-0663-450a-a2ab-791dcbaf9f26 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:01.100712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-286870d4-0663-450a-a2ab-791dcbaf9f26 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:01.103994 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-286870d4-0663-450a-a2ab-791dcbaf9f26 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:01.105261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-286870d4-0663-450a-a2ab-791dcbaf9f26 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:01.553616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:01.712816 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-286870d4-0663-450a-a2ab-791dcbaf9f26 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:01.737068 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-286870d4-0663-450a-a2ab-791dcbaf9f26 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.689102 Jul 25 16:26:01.743782 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 101/176] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:01 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:02.083279 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-da87d90e-ca8f-4c70-93c1-5f6e12fc94ce tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:02.084915 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-da87d90e-ca8f-4c70-93c1-5f6e12fc94ce tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:02.111776 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da87d90e-ca8f-4c70-93c1-5f6e12fc94ce tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:02.112545 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da87d90e-ca8f-4c70-93c1-5f6e12fc94ce tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:02.123409 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da87d90e-ca8f-4c70-93c1-5f6e12fc94ce tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:02.123925 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da87d90e-ca8f-4c70-93c1-5f6e12fc94ce tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:02.594332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-da87d90e-ca8f-4c70-93c1-5f6e12fc94ce tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:02.609000 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-da87d90e-ca8f-4c70-93c1-5f6e12fc94ce tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.532087 Jul 25 16:26:02.612673 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 76/177] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:02 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:02.784213 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-003f675b-3964-43ec-89bc-c4777f4e58ce tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:02.786157 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-003f675b-3964-43ec-89bc-c4777f4e58ce tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:02.794430 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:02.797978 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-003f675b-3964-43ec-89bc-c4777f4e58ce tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:02.798754 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-003f675b-3964-43ec-89bc-c4777f4e58ce tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:02.802801 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-003f675b-3964-43ec-89bc-c4777f4e58ce tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:02.803643 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-003f675b-3964-43ec-89bc-c4777f4e58ce tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:03.179289 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-003f675b-3964-43ec-89bc-c4777f4e58ce tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:03.214793 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-003f675b-3964-43ec-89bc-c4777f4e58ce tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.435770 Jul 25 16:26:03.224641 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 102/178] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:02 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:03.653620 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5d3c024b-cbea-435f-b916-0fca7241db84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:03.654720 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5d3c024b-cbea-435f-b916-0fca7241db84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:03.679041 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d3c024b-cbea-435f-b916-0fca7241db84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:03.679802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d3c024b-cbea-435f-b916-0fca7241db84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:03.681179 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d3c024b-cbea-435f-b916-0fca7241db84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:03.681976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d3c024b-cbea-435f-b916-0fca7241db84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:04.180662 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5d3c024b-cbea-435f-b916-0fca7241db84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:04.204184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5d3c024b-cbea-435f-b916-0fca7241db84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.558869 Jul 25 16:26:04.207876 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 77/179] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:03 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:04.255280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-97e699ca-1f03-4f44-8fa5-d5b1b25d5c58 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:04.256409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-97e699ca-1f03-4f44-8fa5-d5b1b25d5c58 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:04.280607 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-97e699ca-1f03-4f44-8fa5-d5b1b25d5c58 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:04.281263 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-97e699ca-1f03-4f44-8fa5-d5b1b25d5c58 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:04.282771 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-97e699ca-1f03-4f44-8fa5-d5b1b25d5c58 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:04.283510 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-97e699ca-1f03-4f44-8fa5-d5b1b25d5c58 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:04.650815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-97e699ca-1f03-4f44-8fa5-d5b1b25d5c58 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:04.674946 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:04.698028 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-97e699ca-1f03-4f44-8fa5-d5b1b25d5c58 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.449541 Jul 25 16:26:04.702000 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 103/180] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:04 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:05.250323 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a536e42d-456b-4049-913f-e46a3a1fae94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:05.251551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a536e42d-456b-4049-913f-e46a3a1fae94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:05.276504 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a536e42d-456b-4049-913f-e46a3a1fae94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:05.277224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a536e42d-456b-4049-913f-e46a3a1fae94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:05.303166 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a536e42d-456b-4049-913f-e46a3a1fae94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:05.303842 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a536e42d-456b-4049-913f-e46a3a1fae94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:05.710475 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a536e42d-456b-4049-913f-e46a3a1fae94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:05.723025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a536e42d-456b-4049-913f-e46a3a1fae94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.478737 Jul 25 16:26:05.723666 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 78/181] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:05 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:05.737610 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0a47aaad-db1a-4652-ae8a-af1f18b5d629 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:05.738894 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0a47aaad-db1a-4652-ae8a-af1f18b5d629 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:05.757309 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a47aaad-db1a-4652-ae8a-af1f18b5d629 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:05.766375 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a47aaad-db1a-4652-ae8a-af1f18b5d629 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:05.767287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a47aaad-db1a-4652-ae8a-af1f18b5d629 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:05.767831 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0a47aaad-db1a-4652-ae8a-af1f18b5d629 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.141665 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0a47aaad-db1a-4652-ae8a-af1f18b5d629 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:06.152785 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0a47aaad-db1a-4652-ae8a-af1f18b5d629 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.419829 Jul 25 16:26:06.169585 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 104/182] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:05 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:06.768130 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-44423721-1670-4e55-82e1-0e9239fe3a37 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:06.770073 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-44423721-1670-4e55-82e1-0e9239fe3a37 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:06.781136 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44423721-1670-4e55-82e1-0e9239fe3a37 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:06.782469 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44423721-1670-4e55-82e1-0e9239fe3a37 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:06.784551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44423721-1670-4e55-82e1-0e9239fe3a37 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:06.785202 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-44423721-1670-4e55-82e1-0e9239fe3a37 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:07.154090 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-44423721-1670-4e55-82e1-0e9239fe3a37 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:07.184983 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-44423721-1670-4e55-82e1-0e9239fe3a37 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.421914 Jul 25 16:26:07.186147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 79/183] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:06 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:07.188587 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-160159fa-2e8f-4d14-ab4a-200c8366e3ef tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:07.190346 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-160159fa-2e8f-4d14-ab4a-200c8366e3ef tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:07.202727 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-160159fa-2e8f-4d14-ab4a-200c8366e3ef tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:07.205549 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-160159fa-2e8f-4d14-ab4a-200c8366e3ef tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:07.208150 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-160159fa-2e8f-4d14-ab4a-200c8366e3ef tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:07.209142 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-160159fa-2e8f-4d14-ab4a-200c8366e3ef tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:07.586931 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-160159fa-2e8f-4d14-ab4a-200c8366e3ef tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:07.600078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-160159fa-2e8f-4d14-ab4a-200c8366e3ef tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.416953 Jul 25 16:26:07.606777 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-415f1e9b-903f-473e-9f32-c73ea6bbb678 req-82c62760-495a-45ae-b5d2-257b50d605d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93412ce8-1fdb-44e3-b22b-37a7128e8beb", "name": "network-vif-plugged", "status": "completed", "tag": "84fcc185-716f-4766-9f03-7fdf34e835c0"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:07.622412 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 105/184] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:07 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:07.630984 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-415f1e9b-903f-473e-9f32-c73ea6bbb678 req-82c62760-495a-45ae-b5d2-257b50d605d8 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:07.632049 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-415f1e9b-903f-473e-9f32-c73ea6bbb678 req-82c62760-495a-45ae-b5d2-257b50d605d8 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:07.655457 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-415f1e9b-903f-473e-9f32-c73ea6bbb678 req-82c62760-495a-45ae-b5d2-257b50d605d8 service nova] Creating event network-vif-plugged:84fcc185-716f-4766-9f03-7fdf34e835c0 for instance 93412ce8-1fdb-44e3-b22b-37a7128e8beb on hv-cinder-83697 Jul 25 16:26:07.664458 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-415f1e9b-903f-473e-9f32-c73ea6bbb678 req-82c62760-495a-45ae-b5d2-257b50d605d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068383 Jul 25 16:26:07.665729 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 80/185] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:08.228488 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c9a22b6f-45cd-4666-b4f6-c3216b71eb7b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:08.233065 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c9a22b6f-45cd-4666-b4f6-c3216b71eb7b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:08.267291 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a22b6f-45cd-4666-b4f6-c3216b71eb7b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:08.268816 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a22b6f-45cd-4666-b4f6-c3216b71eb7b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:08.274269 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a22b6f-45cd-4666-b4f6-c3216b71eb7b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:08.275479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9a22b6f-45cd-4666-b4f6-c3216b71eb7b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:08.614359 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c9a22b6f-45cd-4666-b4f6-c3216b71eb7b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:08.630388 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d40455bc-6b28-4a59-865a-d1b009c2c11f tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:08.631327 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d40455bc-6b28-4a59-865a-d1b009c2c11f tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:08.635011 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c9a22b6f-45cd-4666-b4f6-c3216b71eb7b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.415270 Jul 25 16:26:08.654048 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 106/186] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:08 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:08.663732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d40455bc-6b28-4a59-865a-d1b009c2c11f tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:08.664690 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d40455bc-6b28-4a59-865a-d1b009c2c11f tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:08.665776 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d40455bc-6b28-4a59-865a-d1b009c2c11f tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:08.666653 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d40455bc-6b28-4a59-865a-d1b009c2c11f tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:09.111670 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d40455bc-6b28-4a59-865a-d1b009c2c11f tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:09.128795 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d40455bc-6b28-4a59-865a-d1b009c2c11f tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.504022 Jul 25 16:26:09.129921 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 81/187] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:08 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:09.676948 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-61a78f26-fb2f-4585-9a0d-cbd183bc2966 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:09.677976 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-61a78f26-fb2f-4585-9a0d-cbd183bc2966 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:09.689356 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61a78f26-fb2f-4585-9a0d-cbd183bc2966 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:09.690142 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61a78f26-fb2f-4585-9a0d-cbd183bc2966 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:09.691882 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61a78f26-fb2f-4585-9a0d-cbd183bc2966 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:09.692599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61a78f26-fb2f-4585-9a0d-cbd183bc2966 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:10.164482 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2e23e419-4931-4e9b-9113-9ea97e445e98 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:10.166638 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2e23e419-4931-4e9b-9113-9ea97e445e98 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:10.195514 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e23e419-4931-4e9b-9113-9ea97e445e98 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:10.196614 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e23e419-4931-4e9b-9113-9ea97e445e98 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:10.198761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e23e419-4931-4e9b-9113-9ea97e445e98 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:10.201868 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2e23e419-4931-4e9b-9113-9ea97e445e98 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:10.737571 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-61a78f26-fb2f-4585-9a0d-cbd183bc2966 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:10.768546 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-61a78f26-fb2f-4585-9a0d-cbd183bc2966 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 1.098361 Jul 25 16:26:10.769890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 107/188] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:09 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:10.812184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2e23e419-4931-4e9b-9113-9ea97e445e98 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:10.892797 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2e23e419-4931-4e9b-9113-9ea97e445e98 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1314 microversion: 2.1 time: 0.733676 Jul 25 16:26:10.895985 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 82/189] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:10 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:11.804133 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-14524aee-1a23-44ce-add0-10a9d51be59d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.807112 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-14524aee-1a23-44ce-add0-10a9d51be59d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:11.820053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14524aee-1a23-44ce-add0-10a9d51be59d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.821824 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14524aee-1a23-44ce-add0-10a9d51be59d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.823696 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14524aee-1a23-44ce-add0-10a9d51be59d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.825514 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14524aee-1a23-44ce-add0-10a9d51be59d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.931206 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a3da93c-b43c-4f6f-974d-a57bdd82ba5b tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:11.937040 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a3da93c-b43c-4f6f-974d-a57bdd82ba5b tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:11.961784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a3da93c-b43c-4f6f-974d-a57bdd82ba5b tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.967599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a3da93c-b43c-4f6f-974d-a57bdd82ba5b tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:11.969490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a3da93c-b43c-4f6f-974d-a57bdd82ba5b tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:11.973759 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a3da93c-b43c-4f6f-974d-a57bdd82ba5b tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:12.348509 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-14524aee-1a23-44ce-add0-10a9d51be59d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:12.375983 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-14524aee-1a23-44ce-add0-10a9d51be59d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1523 microversion: 2.1 time: 0.582643 Jul 25 16:26:12.388498 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 108/190] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:11 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1523 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:12.521592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a3da93c-b43c-4f6f-974d-a57bdd82ba5b tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:12.533819 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a3da93c-b43c-4f6f-974d-a57bdd82ba5b tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1498 microversion: 2.1 time: 0.614256 Jul 25 16:26:12.535475 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 83/191] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:11 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1498 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:13.212590 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-20d5dda0-ca77-4e87-a825-83d2d72207b1 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:13.226490 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-20d5dda0-ca77-4e87-a825-83d2d72207b1 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:13.246187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20d5dda0-ca77-4e87-a825-83d2d72207b1 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:13.250294 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20d5dda0-ca77-4e87-a825-83d2d72207b1 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:13.252578 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20d5dda0-ca77-4e87-a825-83d2d72207b1 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:13.264286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20d5dda0-ca77-4e87-a825-83d2d72207b1 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:13.356953 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-20d5dda0-ca77-4e87-a825-83d2d72207b1 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:26:13.415308 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c21eecce-6e1d-43bb-9398-c5110715e33e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:13.420194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c21eecce-6e1d-43bb-9398-c5110715e33e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:13.449788 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21eecce-6e1d-43bb-9398-c5110715e33e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:13.450744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21eecce-6e1d-43bb-9398-c5110715e33e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:13.455899 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21eecce-6e1d-43bb-9398-c5110715e33e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:13.456573 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c21eecce-6e1d-43bb-9398-c5110715e33e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:13.654765 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-20d5dda0-ca77-4e87-a825-83d2d72207b1 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "DELETE /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 204 len: 0 microversion: 2.1 time: 0.451216 Jul 25 16:26:13.655915 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 109/192] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:26:13 2022] DELETE /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:26:13.676787 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dcf383f2-f532-4ef1-a8f6-1c2abaf77f2a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:13.678192 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dcf383f2-f532-4ef1-a8f6-1c2abaf77f2a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:13.690433 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dcf383f2-f532-4ef1-a8f6-1c2abaf77f2a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:13.691190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dcf383f2-f532-4ef1-a8f6-1c2abaf77f2a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:13.694098 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dcf383f2-f532-4ef1-a8f6-1c2abaf77f2a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:13.695121 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dcf383f2-f532-4ef1-a8f6-1c2abaf77f2a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:13.977081 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c21eecce-6e1d-43bb-9398-c5110715e33e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:13.993614 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c21eecce-6e1d-43bb-9398-c5110715e33e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1503 microversion: 2.1 time: 0.588510 Jul 25 16:26:13.994243 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 84/193] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:13 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1503 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:14.050649 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8639cc26-bb97-4bdb-85da-39a9c033d5e9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:14.053023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8639cc26-bb97-4bdb-85da-39a9c033d5e9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:14.078657 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8639cc26-bb97-4bdb-85da-39a9c033d5e9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:14.079390 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8639cc26-bb97-4bdb-85da-39a9c033d5e9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:14.080916 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8639cc26-bb97-4bdb-85da-39a9c033d5e9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:14.082414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8639cc26-bb97-4bdb-85da-39a9c033d5e9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:14.483212 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dcf383f2-f532-4ef1-a8f6-1c2abaf77f2a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:14.511495 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dcf383f2-f532-4ef1-a8f6-1c2abaf77f2a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1504 microversion: 2.1 time: 0.847592 Jul 25 16:26:14.516210 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 110/194] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:13 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1504 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:14.674608 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8639cc26-bb97-4bdb-85da-39a9c033d5e9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:14.694365 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8639cc26-bb97-4bdb-85da-39a9c033d5e9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1515 microversion: 2.1 time: 0.677481 Jul 25 16:26:14.695381 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 85/195] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:14 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1515 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:15.555815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2bf62933-e75b-4fba-8572-9ffd0b8f43a3 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:15.562112 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2bf62933-e75b-4fba-8572-9ffd0b8f43a3 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:15.591560 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2bf62933-e75b-4fba-8572-9ffd0b8f43a3 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:15.594962 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2bf62933-e75b-4fba-8572-9ffd0b8f43a3 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:15.599108 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2bf62933-e75b-4fba-8572-9ffd0b8f43a3 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:15.601896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2bf62933-e75b-4fba-8572-9ffd0b8f43a3 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:16.288997 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2bf62933-e75b-4fba-8572-9ffd0b8f43a3 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:16.307369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2bf62933-e75b-4fba-8572-9ffd0b8f43a3 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1504 microversion: 2.1 time: 0.760594 Jul 25 16:26:16.307865 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 111/196] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:15 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1504 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:16.935287 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f13953f0-3de5-4ccf-8076-8353565b8da6 req-90a09d91-9da9-49c9-956e-2dd24cd4ed6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93412ce8-1fdb-44e3-b22b-37a7128e8beb", "name": "network-vif-deleted", "tag": "84fcc185-716f-4766-9f03-7fdf34e835c0"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:16.970508 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f13953f0-3de5-4ccf-8076-8353565b8da6 req-90a09d91-9da9-49c9-956e-2dd24cd4ed6e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:16.973076 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f13953f0-3de5-4ccf-8076-8353565b8da6 req-90a09d91-9da9-49c9-956e-2dd24cd4ed6e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:17.031159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f13953f0-3de5-4ccf-8076-8353565b8da6 req-90a09d91-9da9-49c9-956e-2dd24cd4ed6e service nova] Creating event network-vif-deleted:84fcc185-716f-4766-9f03-7fdf34e835c0 for instance 93412ce8-1fdb-44e3-b22b-37a7128e8beb on hv-cinder-83697 Jul 25 16:26:17.054521 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f13953f0-3de5-4ccf-8076-8353565b8da6 req-90a09d91-9da9-49c9-956e-2dd24cd4ed6e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127224 Jul 25 16:26:17.055871 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 86/197] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:26:17.322333 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-87d24ec4-1177-4925-9e38-e498f70bef60 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:17.329315 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-87d24ec4-1177-4925-9e38-e498f70bef60 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:17.343406 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:17.344172 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:17.365309 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87d24ec4-1177-4925-9e38-e498f70bef60 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:17.365793 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87d24ec4-1177-4925-9e38-e498f70bef60 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:17.371227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:17.371783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:17.372726 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:17.373196 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:17.380444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87d24ec4-1177-4925-9e38-e498f70bef60 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:17.381428 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87d24ec4-1177-4925-9e38-e498f70bef60 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:17.468408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-87d24ec4-1177-4925-9e38-e498f70bef60 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lazy-loading 'flavor' on Instance uuid c89d38b5-02b2-4e63-8dca-04b967a8cf14 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:26:17.520987 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:17.525291 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:17.527684 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lazy-loading 'fault' on Instance uuid 93412ce8-1fdb-44e3-b22b-37a7128e8beb {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:26:17.808575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:17.826668 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eadbcd28-ea46-441a-84f3-678249632f5a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 200 len: 1304 microversion: 2.1 time: 0.489355 Jul 25 16:26:17.851600 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 87/198] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:17 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 1304 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:17.961205 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-87d24ec4-1177-4925-9e38-e498f70bef60 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14/action" status: 200 len: 32 microversion: 2.1 time: 0.649628 Jul 25 16:26:17.978814 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 112/199] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:26:17 2022] POST /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14/action => generated 32 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:26:17.998209 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3aef5da9-291b-420a-8df7-d68723f37c65 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:18.004424 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3aef5da9-291b-420a-8df7-d68723f37c65 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:18.029414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3aef5da9-291b-420a-8df7-d68723f37c65 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:18.030702 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3aef5da9-291b-420a-8df7-d68723f37c65 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:18.032951 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3aef5da9-291b-420a-8df7-d68723f37c65 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:18.034352 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3aef5da9-291b-420a-8df7-d68723f37c65 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:18.507490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3aef5da9-291b-420a-8df7-d68723f37c65 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:18.540799 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3aef5da9-291b-420a-8df7-d68723f37c65 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.549765 Jul 25 16:26:18.554108 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 88/200] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:17 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:18.867201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:18.874667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: 93412ce8-1fdb-44e3-b22b-37a7128e8beb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:18.900408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:18.905685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:18.907528 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:18.908288 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:18.985963 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] HTTP exception thrown: Instance 93412ce8-1fdb-44e3-b22b-37a7128e8beb could not be found. Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Request method failure captured: Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb HTTP/1.1 Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sQJzkyEGKxeKJADaAGEnXdoOdYoKzt_k99AET1Om7TvvJnZWAwu7_LcI4unvfWJ6FIUUrUsJsHYksoMR7bsfO1CSAoSH3smuJBWhcNizAH_h8h-KXAsmoAJbBjz1f1jnu_62l1iblpViq34pHQDFr2pX1MCr1ja3lzsILXIWMIkOKc Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 1b1fba96612b4ed0ae53b43cdd4e3528 Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesActionsTest-2115364438 Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:26:18.990557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1b1fba96612b4ed0ae53b43cdd4e3528"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b1fba96612b4ed0ae53b43cdd4e3528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b1fba96612b4ed0ae53b43cdd4e3528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1b1fba96612b4ed0ae53b43cdd4e3528"}]}] Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesActionsTest-2115364438 Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 1b1fba96612b4ed0ae53b43cdd4e3528 Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesActionsTest-2115364438 Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesActionsTest-2115364438-project Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: bb3927ae30c54149974d3037c1022854 Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesActionsTest-2115364438-project Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 93412ce8-1fdb-44e3-b22b-37a7128e8beb could not be found. Jul 25 16:26:18.993086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '93412ce8-1fdb-44e3-b22b-37a7128e8beb'} Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93412ce8-1fdb-44e3-b22b-37a7128e8beb could not be found. Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:18.994667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93412ce8-1fdb-44e3-b22b-37a7128e8beb could not be found. Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93412ce8-1fdb-44e3-b22b-37a7128e8beb could not be found. Jul 25 16:26:18.997432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:19.000258 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Returning 404 to user: Instance 93412ce8-1fdb-44e3-b22b-37a7128e8beb could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:19.000258 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fa3421b2-eeee-4030-b09e-766240bbb763 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb" status: 404 len: 111 microversion: 2.1 time: 0.140313 Jul 25 16:26:19.007526 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 113/201] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:18 2022] GET /compute/v2.1/servers/93412ce8-1fdb-44e3-b22b-37a7128e8beb => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:19.328340 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-749878433", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "networks": [{"uuid": "0410d071-03f1-4e3a-a75f-6200cc3088da"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:19.509958 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] validate_networks() for [('0410d071-03f1-4e3a-a75f-6200cc3088da', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:26:19.581409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6213bcf7-cac7-4e73-86eb-1e655d076202 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:19.587167 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6213bcf7-cac7-4e73-86eb-1e655d076202 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:19.620328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6213bcf7-cac7-4e73-86eb-1e655d076202 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:19.626532 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6213bcf7-cac7-4e73-86eb-1e655d076202 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:19.628321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6213bcf7-cac7-4e73-86eb-1e655d076202 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:19.629166 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6213bcf7-cac7-4e73-86eb-1e655d076202 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:20.242490 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6213bcf7-cac7-4e73-86eb-1e655d076202 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:20.263925 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6213bcf7-cac7-4e73-86eb-1e655d076202 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.689312 Jul 25 16:26:20.266590 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 114/202] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:19 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:20.935918 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:26:20.939387 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:26:20.946387 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:26:20.953048 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:26:20.953048 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:26:20.990750 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:20.991525 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:20.993110 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:20.993918 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:21.081951 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Getting quotas for project 1b1fba96612b4ed0ae53b43cdd4e3528. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:26:21.090518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Getting quotas for user bb3927ae30c54149974d3037c1022854 and project 1b1fba96612b4ed0ae53b43cdd4e3528. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:26:21.111677 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:26:21.116994 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:26:21.222056 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0fbbdc77-8ab9-42c4-9714-37cb7563b103 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.902448 Jul 25 16:26:21.223366 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 89/203] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:26:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:26:21.245307 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0f241dcc-b5d9-4154-bec6-e1ca256a58ad tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:21.247639 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0f241dcc-b5d9-4154-bec6-e1ca256a58ad tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:21.312332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-088fa7bd-b9cc-4243-a286-8d9fe2a7675e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:21.313961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-088fa7bd-b9cc-4243-a286-8d9fe2a7675e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:21.343250 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-088fa7bd-b9cc-4243-a286-8d9fe2a7675e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:21.343250 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-088fa7bd-b9cc-4243-a286-8d9fe2a7675e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:21.351146 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-088fa7bd-b9cc-4243-a286-8d9fe2a7675e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:21.351767 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-088fa7bd-b9cc-4243-a286-8d9fe2a7675e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:21.399869 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0f241dcc-b5d9-4154-bec6-e1ca256a58ad tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:21.413423 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0f241dcc-b5d9-4154-bec6-e1ca256a58ad tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1213 microversion: 2.1 time: 0.180133 Jul 25 16:26:21.414963 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 115/204] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:21 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1213 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:21.660083 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-088fa7bd-b9cc-4243-a286-8d9fe2a7675e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:21.676184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-088fa7bd-b9cc-4243-a286-8d9fe2a7675e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.370765 Jul 25 16:26:21.678713 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 90/205] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:21 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:22.445878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-27363626-365a-4053-9258-1ba12fd75644 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:22.456628 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-27363626-365a-4053-9258-1ba12fd75644 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:22.484402 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27363626-365a-4053-9258-1ba12fd75644 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:22.485360 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27363626-365a-4053-9258-1ba12fd75644 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:22.487494 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27363626-365a-4053-9258-1ba12fd75644 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:22.491897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27363626-365a-4053-9258-1ba12fd75644 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:22.710758 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e7fa3f92-a360-4606-a37c-4243845fc7db tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:22.718194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e7fa3f92-a360-4606-a37c-4243845fc7db tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:22.748230 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7fa3f92-a360-4606-a37c-4243845fc7db tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:22.753996 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7fa3f92-a360-4606-a37c-4243845fc7db tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:22.755862 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7fa3f92-a360-4606-a37c-4243845fc7db tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:22.760487 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e7fa3f92-a360-4606-a37c-4243845fc7db tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:22.792215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-27363626-365a-4053-9258-1ba12fd75644 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:22.816314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-27363626-365a-4053-9258-1ba12fd75644 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1209 microversion: 2.1 time: 0.377458 Jul 25 16:26:22.818493 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 116/206] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:22 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1209 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:22.864043 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:23.288232 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e7fa3f92-a360-4606-a37c-4243845fc7db tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:23.332829 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e7fa3f92-a360-4606-a37c-4243845fc7db tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.632215 Jul 25 16:26:23.347568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 91/207] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:22 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:23.866088 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-32575acf-7a45-4704-a83c-754ee72ec821 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:23.868166 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-32575acf-7a45-4704-a83c-754ee72ec821 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:23.889781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32575acf-7a45-4704-a83c-754ee72ec821 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:23.890729 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32575acf-7a45-4704-a83c-754ee72ec821 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:23.893329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32575acf-7a45-4704-a83c-754ee72ec821 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:23.893329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32575acf-7a45-4704-a83c-754ee72ec821 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:24.113542 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-32575acf-7a45-4704-a83c-754ee72ec821 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:24.127556 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-32575acf-7a45-4704-a83c-754ee72ec821 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1271 microversion: 2.1 time: 0.268865 Jul 25 16:26:24.142676 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 117/208] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:23 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:24.378111 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-19a9f688-86af-40f9-95ad-c2ebe9c9bf16 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:24.378854 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-19a9f688-86af-40f9-95ad-c2ebe9c9bf16 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:24.406286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19a9f688-86af-40f9-95ad-c2ebe9c9bf16 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:24.407042 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19a9f688-86af-40f9-95ad-c2ebe9c9bf16 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:24.408656 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19a9f688-86af-40f9-95ad-c2ebe9c9bf16 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:24.417802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-19a9f688-86af-40f9-95ad-c2ebe9c9bf16 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:25.012075 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-19a9f688-86af-40f9-95ad-c2ebe9c9bf16 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:25.037241 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-19a9f688-86af-40f9-95ad-c2ebe9c9bf16 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.667604 Jul 25 16:26:25.053928 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 92/209] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:24 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:25.167002 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b43005cb-6dc8-4879-aa0f-13d6aa4e081a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:25.169206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b43005cb-6dc8-4879-aa0f-13d6aa4e081a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:25.182160 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b43005cb-6dc8-4879-aa0f-13d6aa4e081a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:25.183009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b43005cb-6dc8-4879-aa0f-13d6aa4e081a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:25.184016 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b43005cb-6dc8-4879-aa0f-13d6aa4e081a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:25.184613 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b43005cb-6dc8-4879-aa0f-13d6aa4e081a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:25.222770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:25.373970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b43005cb-6dc8-4879-aa0f-13d6aa4e081a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:25.408733 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b43005cb-6dc8-4879-aa0f-13d6aa4e081a tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1271 microversion: 2.1 time: 0.249392 Jul 25 16:26:25.409782 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 118/210] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:25 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:26.082731 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-67c45ace-4098-4928-a6b1-34399038d6de tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:26.085213 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-67c45ace-4098-4928-a6b1-34399038d6de tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:26.109634 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67c45ace-4098-4928-a6b1-34399038d6de tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:26.112206 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67c45ace-4098-4928-a6b1-34399038d6de tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:26.115503 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67c45ace-4098-4928-a6b1-34399038d6de tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:26.116807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67c45ace-4098-4928-a6b1-34399038d6de tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:26.456191 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f11acf76-c8ee-45b8-819e-047399843952 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:26.464151 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f11acf76-c8ee-45b8-819e-047399843952 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:26.484542 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f11acf76-c8ee-45b8-819e-047399843952 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:26.487373 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f11acf76-c8ee-45b8-819e-047399843952 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:26.493558 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f11acf76-c8ee-45b8-819e-047399843952 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:26.494679 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f11acf76-c8ee-45b8-819e-047399843952 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:26.620073 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67c45ace-4098-4928-a6b1-34399038d6de tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:26.643314 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-67c45ace-4098-4928-a6b1-34399038d6de tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.569839 Jul 25 16:26:26.650498 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 93/211] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:26 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:26.928720 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f11acf76-c8ee-45b8-819e-047399843952 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:26.950777 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f11acf76-c8ee-45b8-819e-047399843952 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1313 microversion: 2.1 time: 0.502230 Jul 25 16:26:26.958020 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 119/212] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:26 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:27.350473 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b7c41fa2-ff53-4cf4-9e12-80544afee6d6 req-5c9715b7-2d95-4d23-a493-5087001527a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd756e5e-ca84-457f-80c1-74f1d72aef9c", "tag": "008cb211-79e5-4948-afe2-61340825b0e1"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:27.379277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:27.385329 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b7c41fa2-ff53-4cf4-9e12-80544afee6d6 req-5c9715b7-2d95-4d23-a493-5087001527a4 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:27.386691 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b7c41fa2-ff53-4cf4-9e12-80544afee6d6 req-5c9715b7-2d95-4d23-a493-5087001527a4 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:27.420606 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b7c41fa2-ff53-4cf4-9e12-80544afee6d6 req-5c9715b7-2d95-4d23-a493-5087001527a4 service nova] Creating event network-changed:008cb211-79e5-4948-afe2-61340825b0e1 for instance bd756e5e-ca84-457f-80c1-74f1d72aef9c on hv-cinder-83697 Jul 25 16:26:27.430613 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b7c41fa2-ff53-4cf4-9e12-80544afee6d6 req-5c9715b7-2d95-4d23-a493-5087001527a4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090001 Jul 25 16:26:27.435146 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 94/213] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:27.464674 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4f6bc0ba-2841-48df-850f-ae266ee0c357 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:27.465207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4f6bc0ba-2841-48df-850f-ae266ee0c357 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:27.474702 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f6bc0ba-2841-48df-850f-ae266ee0c357 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:27.475595 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f6bc0ba-2841-48df-850f-ae266ee0c357 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:27.476964 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f6bc0ba-2841-48df-850f-ae266ee0c357 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:27.477709 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4f6bc0ba-2841-48df-850f-ae266ee0c357 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:27.531797 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4f6bc0ba-2841-48df-850f-ae266ee0c357 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/ips" status: 200 len: 145 microversion: 2.1 time: 0.071480 Jul 25 16:26:27.533599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 120/214] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:26:27 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/ips => generated 145 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:26:27.690576 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e4768430-d399-410e-bfed-168ca885c818 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:27.691872 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e4768430-d399-410e-bfed-168ca885c818 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:27.702510 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4768430-d399-410e-bfed-168ca885c818 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:27.703024 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4768430-d399-410e-bfed-168ca885c818 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:27.704173 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4768430-d399-410e-bfed-168ca885c818 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:27.704705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e4768430-d399-410e-bfed-168ca885c818 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:27.987666 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d349a082-71c8-4d45-be0a-26663d961239 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:27.989231 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d349a082-71c8-4d45-be0a-26663d961239 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:28.017929 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d349a082-71c8-4d45-be0a-26663d961239 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:28.018808 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d349a082-71c8-4d45-be0a-26663d961239 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:28.019793 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e4768430-d399-410e-bfed-168ca885c818 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:28.022456 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d349a082-71c8-4d45-be0a-26663d961239 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:28.025225 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d349a082-71c8-4d45-be0a-26663d961239 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:28.056603 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e4768430-d399-410e-bfed-168ca885c818 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.372257 Jul 25 16:26:28.059825 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 95/215] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:27 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:28.300185 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d349a082-71c8-4d45-be0a-26663d961239 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:28.310068 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d349a082-71c8-4d45-be0a-26663d961239 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1313 microversion: 2.1 time: 0.327671 Jul 25 16:26:28.311604 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 121/216] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:27 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:29.095208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00c5325e-bfc9-4fa0-b426-4b39c5130fdb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:29.095975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00c5325e-bfc9-4fa0-b426-4b39c5130fdb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:29.110373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00c5325e-bfc9-4fa0-b426-4b39c5130fdb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:29.111488 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00c5325e-bfc9-4fa0-b426-4b39c5130fdb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:29.113635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00c5325e-bfc9-4fa0-b426-4b39c5130fdb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:29.115078 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00c5325e-bfc9-4fa0-b426-4b39c5130fdb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:29.344024 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c66c4f3f-6854-4bee-94a4-dc0872b2a904 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:29.346015 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c66c4f3f-6854-4bee-94a4-dc0872b2a904 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:29.380408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c66c4f3f-6854-4bee-94a4-dc0872b2a904 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:29.382190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c66c4f3f-6854-4bee-94a4-dc0872b2a904 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:29.384812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c66c4f3f-6854-4bee-94a4-dc0872b2a904 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:29.387264 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c66c4f3f-6854-4bee-94a4-dc0872b2a904 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:29.440599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00c5325e-bfc9-4fa0-b426-4b39c5130fdb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:29.453129 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00c5325e-bfc9-4fa0-b426-4b39c5130fdb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.362370 Jul 25 16:26:29.455314 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 96/217] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:29 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:29.734600 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c66c4f3f-6854-4bee-94a4-dc0872b2a904 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:29.749079 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c66c4f3f-6854-4bee-94a4-dc0872b2a904 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1313 microversion: 2.1 time: 0.418266 Jul 25 16:26:29.750217 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 122/218] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:29 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:30.488676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6c79f535-2e7b-4c6c-813d-5524f43c73b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:30.491105 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6c79f535-2e7b-4c6c-813d-5524f43c73b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:30.503480 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c79f535-2e7b-4c6c-813d-5524f43c73b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:30.504441 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c79f535-2e7b-4c6c-813d-5524f43c73b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:30.506102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c79f535-2e7b-4c6c-813d-5524f43c73b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:30.506846 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c79f535-2e7b-4c6c-813d-5524f43c73b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:30.772556 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6c79f535-2e7b-4c6c-813d-5524f43c73b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:30.789881 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6c79f535-2e7b-4c6c-813d-5524f43c73b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.314282 Jul 25 16:26:30.792454 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 97/219] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:30 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:30.794075 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-174f85c4-75d0-4dfe-88d6-8ceb2fde8956 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:30.796058 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-174f85c4-75d0-4dfe-88d6-8ceb2fde8956 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:30.808583 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-174f85c4-75d0-4dfe-88d6-8ceb2fde8956 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:30.809808 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-174f85c4-75d0-4dfe-88d6-8ceb2fde8956 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:30.811699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-174f85c4-75d0-4dfe-88d6-8ceb2fde8956 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:30.813076 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-174f85c4-75d0-4dfe-88d6-8ceb2fde8956 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:31.217515 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-174f85c4-75d0-4dfe-88d6-8ceb2fde8956 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:31.239228 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-174f85c4-75d0-4dfe-88d6-8ceb2fde8956 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1313 microversion: 2.1 time: 0.455590 Jul 25 16:26:31.249984 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 123/220] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:30 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:31.263366 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a33e060d-3858-423c-a00b-97e75650e195 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7c9ba06-ad6c-4322-a101-3b8b782e735a"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:31.267567 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a33e060d-3858-423c-a00b-97e75650e195 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:31.287876 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:31.291223 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:31.314910 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a33e060d-3858-423c-a00b-97e75650e195 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:31.319603 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a33e060d-3858-423c-a00b-97e75650e195 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:31.324445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a33e060d-3858-423c-a00b-97e75650e195 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:31.325896 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a33e060d-3858-423c-a00b-97e75650e195 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:31.836891 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-98475324-56c4-45ec-bf3d-29815764aa24 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:31.840906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-98475324-56c4-45ec-bf3d-29815764aa24 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:31.874361 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:31.877836 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98475324-56c4-45ec-bf3d-29815764aa24 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:31.878937 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98475324-56c4-45ec-bf3d-29815764aa24 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:31.879983 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98475324-56c4-45ec-bf3d-29815764aa24 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:31.880706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-98475324-56c4-45ec-bf3d-29815764aa24 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:32.317124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-98475324-56c4-45ec-bf3d-29815764aa24 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:32.332255 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-98475324-56c4-45ec-bf3d-29815764aa24 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.502831 Jul 25 16:26:32.333127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 124/221] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:31 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:32.349734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-35aee503-8087-4356-9ff3-15d1f723a268 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:32.349734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-35aee503-8087-4356-9ff3-15d1f723a268 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:32.349734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35aee503-8087-4356-9ff3-15d1f723a268 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:32.350940 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35aee503-8087-4356-9ff3-15d1f723a268 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:32.351948 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35aee503-8087-4356-9ff3-15d1f723a268 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:32.352611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-35aee503-8087-4356-9ff3-15d1f723a268 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:32.733134 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-35aee503-8087-4356-9ff3-15d1f723a268 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:32.780553 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-35aee503-8087-4356-9ff3-15d1f723a268 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1313 microversion: 2.1 time: 0.445467 Jul 25 16:26:32.786504 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 125/222] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:32 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:33.384497 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-66010ba1-9a73-46d4-83e3-b9f0ce6f66b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:33.387983 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-66010ba1-9a73-46d4-83e3-b9f0ce6f66b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:33.399204 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:33.406193 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66010ba1-9a73-46d4-83e3-b9f0ce6f66b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:33.407330 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66010ba1-9a73-46d4-83e3-b9f0ce6f66b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:33.408859 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66010ba1-9a73-46d4-83e3-b9f0ce6f66b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:33.409954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66010ba1-9a73-46d4-83e3-b9f0ce6f66b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:34.410589 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-66010ba1-9a73-46d4-83e3-b9f0ce6f66b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:34.426385 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-66010ba1-9a73-46d4-83e3-b9f0ce6f66b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 1.051935 Jul 25 16:26:34.429734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 126/223] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:33 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:34.439746 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a514e298-30ce-4544-9895-94200599204c tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:34.440959 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a514e298-30ce-4544-9895-94200599204c tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:34.460452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a514e298-30ce-4544-9895-94200599204c tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:34.461779 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a514e298-30ce-4544-9895-94200599204c tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:34.463005 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a514e298-30ce-4544-9895-94200599204c tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:34.463962 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a514e298-30ce-4544-9895-94200599204c tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:34.550958 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a33e060d-3858-423c-a00b-97e75650e195 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.299036 Jul 25 16:26:34.577665 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 98/224] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:26:31 2022] POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/os-volume_attachments => generated 194 bytes in 3328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:35.467805 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-48d18763-67ec-474a-b099-9de5f3ba90c9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:35.481264 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-48d18763-67ec-474a-b099-9de5f3ba90c9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:35.512215 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48d18763-67ec-474a-b099-9de5f3ba90c9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:35.514998 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48d18763-67ec-474a-b099-9de5f3ba90c9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:35.528199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48d18763-67ec-474a-b099-9de5f3ba90c9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:35.529730 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48d18763-67ec-474a-b099-9de5f3ba90c9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:35.734051 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a514e298-30ce-4544-9895-94200599204c tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:35.774551 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a514e298-30ce-4544-9895-94200599204c tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1313 microversion: 2.1 time: 1.340516 Jul 25 16:26:35.790622 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 127/225] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:34 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1313 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:36.096464 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-48d18763-67ec-474a-b099-9de5f3ba90c9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:36.134081 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-48d18763-67ec-474a-b099-9de5f3ba90c9 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1501 microversion: 2.1 time: 0.673804 Jul 25 16:26:36.136975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 99/226] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:35 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1501 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:36.188066 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04dd71bc-fc1e-4f6d-b1a7-9d18dbbf02f4"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:36.192436 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:36.224046 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.230650 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.232599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.233840 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.351606 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] HTTP exception thrown: Cannot 'attach_volume' instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 while it is in vm_state rescued Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Request method failure captured: Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14/os-volume_attachments HTTP/1.1 Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 74 Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sPKb9Fb-vH6xnT2mTjLGFd_QOBpmsX1Y8Rb9D03weDBhasNylRXYbFmkU2x6iERYZs7_9KM7dgcaOtpoTwNfAqLh_Na3tcjAOtL2BmuoAUQGulpjfzj19IPXftQo2eRfFhz3u8oML9jDvt8ZBdSwS3KFDldQI-3LKks8yVzk6uD41w Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:26:36.355089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18b6e0eaf4eb48868a683c7769d3df7a"}]}] Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 2d1eb89923784f1c83d2077c6b6926e9 Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {"volumeAttachment": {"volumeId": "04dd71bc-fc1e-4f6d-b1a7-9d18dbbf02f4"}} Jul 25 16:26:36.357369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Cannot 'attach_volume' instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 while it is in vm_state rescued Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'server_id': 'c89d38b5-02b2-4e63-8dca-04b967a8cf14', 'body': {'volumeAttachment': {'volumeId': '04dd71bc-fc1e-4f6d-b1a7-9d18dbbf02f4'}}} Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:36.358197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 while it is in vm_state rescued Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:36.360034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:36.363660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:36.363660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:36.363660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 while it is in vm_state rescued Jul 25 16:26:36.363660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:36.365933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Returning 409 to user: Cannot 'attach_volume' instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 while it is in vm_state rescued {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:36.367936 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a848f2b4-0d65-4101-8945-eb07c17e1a75 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.191471 Jul 25 16:26:36.369087 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 128/227] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:26:36 2022] POST /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14/os-volume_attachments => generated 152 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:26:36.403235 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-483757c1-10d5-4947-a06c-a0a8c69ea611 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:36.405015 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-483757c1-10d5-4947-a06c-a0a8c69ea611 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:36.424055 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-483757c1-10d5-4947-a06c-a0a8c69ea611 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.426320 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-483757c1-10d5-4947-a06c-a0a8c69ea611 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.429946 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-483757c1-10d5-4947-a06c-a0a8c69ea611 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.431160 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-483757c1-10d5-4947-a06c-a0a8c69ea611 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.651095 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-3cdaa71a-0bc8-46c3-b6b6-a6403fd3520b req-5cd7ff77-8d24-4d8b-b3c1-99e3ad047dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd756e5e-ca84-457f-80c1-74f1d72aef9c", "name": "network-vif-plugged", "status": "completed", "tag": "008cb211-79e5-4948-afe2-61340825b0e1"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:36.689020 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-3cdaa71a-0bc8-46c3-b6b6-a6403fd3520b req-5cd7ff77-8d24-4d8b-b3c1-99e3ad047dd3 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.690378 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-3cdaa71a-0bc8-46c3-b6b6-a6403fd3520b req-5cd7ff77-8d24-4d8b-b3c1-99e3ad047dd3 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.704883 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-3cdaa71a-0bc8-46c3-b6b6-a6403fd3520b req-5cd7ff77-8d24-4d8b-b3c1-99e3ad047dd3 service nova] Creating event network-vif-plugged:008cb211-79e5-4948-afe2-61340825b0e1 for instance bd756e5e-ca84-457f-80c1-74f1d72aef9c on hv-cinder-83697 Jul 25 16:26:36.714116 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-3cdaa71a-0bc8-46c3-b6b6-a6403fd3520b req-5cd7ff77-8d24-4d8b-b3c1-99e3ad047dd3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075427 Jul 25 16:26:36.715318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 129/228] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:36.815226 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-483757c1-10d5-4947-a06c-a0a8c69ea611 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14/action" status: 202 len: 0 microversion: 2.1 time: 0.436050 Jul 25 16:26:36.822158 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 100/229] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:26:36 2022] POST /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:26:36.831871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1eeaa6c1-305e-47a7-a3de-0933df2056e9 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:36.832629 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1eeaa6c1-305e-47a7-a3de-0933df2056e9 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:36.841873 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8e4ef07-ea0f-427e-b12a-a8fc22fd9813 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:36.843444 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8e4ef07-ea0f-427e-b12a-a8fc22fd9813 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:36.852380 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8e4ef07-ea0f-427e-b12a-a8fc22fd9813 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.853748 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8e4ef07-ea0f-427e-b12a-a8fc22fd9813 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.855328 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8e4ef07-ea0f-427e-b12a-a8fc22fd9813 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.856117 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8e4ef07-ea0f-427e-b12a-a8fc22fd9813 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.858252 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1eeaa6c1-305e-47a7-a3de-0933df2056e9 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.858706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1eeaa6c1-305e-47a7-a3de-0933df2056e9 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:36.859621 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1eeaa6c1-305e-47a7-a3de-0933df2056e9 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:36.860103 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1eeaa6c1-305e-47a7-a3de-0933df2056e9 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:37.658841 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1eeaa6c1-305e-47a7-a3de-0933df2056e9 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:37.678031 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8e4ef07-ea0f-427e-b12a-a8fc22fd9813 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:37.679174 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1eeaa6c1-305e-47a7-a3de-0933df2056e9 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1313 microversion: 2.1 time: 0.857764 Jul 25 16:26:37.680933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 130/230] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:36 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:37.730182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8e4ef07-ea0f-427e-b12a-a8fc22fd9813 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1509 microversion: 2.1 time: 0.905343 Jul 25 16:26:37.732482 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 101/231] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:36 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1509 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:38.719867 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-797e3b03-a1e5-4c44-83ff-8cb54d14faeb tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:38.722169 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-797e3b03-a1e5-4c44-83ff-8cb54d14faeb tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:38.749131 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-797e3b03-a1e5-4c44-83ff-8cb54d14faeb tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-797e3b03-a1e5-4c44-83ff-8cb54d14faeb tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:38.751851 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-797e3b03-a1e5-4c44-83ff-8cb54d14faeb tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.752815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-797e3b03-a1e5-4c44-83ff-8cb54d14faeb tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:38.776948 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-de83a44a-a855-4ad7-a909-919d30d64693 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:38.777871 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-de83a44a-a855-4ad7-a909-919d30d64693 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:38.803138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de83a44a-a855-4ad7-a909-919d30d64693 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.803591 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de83a44a-a855-4ad7-a909-919d30d64693 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:38.813329 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de83a44a-a855-4ad7-a909-919d30d64693 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:38.814664 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-de83a44a-a855-4ad7-a909-919d30d64693 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:39.792489 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-de83a44a-a855-4ad7-a909-919d30d64693 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:39.811003 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-de83a44a-a855-4ad7-a909-919d30d64693 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1509 microversion: 2.1 time: 1.041010 Jul 25 16:26:39.812760 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 102/232] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:38 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1509 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:39.861274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-797e3b03-a1e5-4c44-83ff-8cb54d14faeb tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:39.893843 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-797e3b03-a1e5-4c44-83ff-8cb54d14faeb tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1313 microversion: 2.1 time: 1.175828 Jul 25 16:26:39.894656 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 131/233] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:38 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1313 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:40.842405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f37d2900-6241-41c4-9e30-833c22c9a17b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:40.849430 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f37d2900-6241-41c4-9e30-833c22c9a17b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:40.901892 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f37d2900-6241-41c4-9e30-833c22c9a17b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:40.905203 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f37d2900-6241-41c4-9e30-833c22c9a17b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:40.906337 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f37d2900-6241-41c4-9e30-833c22c9a17b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:40.907847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f37d2900-6241-41c4-9e30-833c22c9a17b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:40.939440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fff5bfcd-92a6-4af9-b07f-7b02ce80138d tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:40.949919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fff5bfcd-92a6-4af9-b07f-7b02ce80138d tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:40.969393 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fff5bfcd-92a6-4af9-b07f-7b02ce80138d tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:40.970605 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fff5bfcd-92a6-4af9-b07f-7b02ce80138d tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:40.972017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fff5bfcd-92a6-4af9-b07f-7b02ce80138d tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:40.972778 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fff5bfcd-92a6-4af9-b07f-7b02ce80138d tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:41.816423 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fff5bfcd-92a6-4af9-b07f-7b02ce80138d tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:41.841826 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fff5bfcd-92a6-4af9-b07f-7b02ce80138d tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1497 microversion: 2.1 time: 0.924565 Jul 25 16:26:41.846037 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 132/234] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:40 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1497 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:41.859203 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f37d2900-6241-41c4-9e30-833c22c9a17b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:41.886454 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f37d2900-6241-41c4-9e30-833c22c9a17b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1509 microversion: 2.1 time: 1.054870 Jul 25 16:26:41.888861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 103/235] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:40 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1509 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:42.913027 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b9e99948-82fd-4cfd-bdf7-8e1e58450344 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:42.914178 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b9e99948-82fd-4cfd-bdf7-8e1e58450344 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:42.971182 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b9e99948-82fd-4cfd-bdf7-8e1e58450344 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.977361 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b9e99948-82fd-4cfd-bdf7-8e1e58450344 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:42.977361 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b9e99948-82fd-4cfd-bdf7-8e1e58450344 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:42.994040 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b9e99948-82fd-4cfd-bdf7-8e1e58450344 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:43.334196 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9f93adba-bd56-46cc-8f70-9bd13d50d734 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:43.335409 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9f93adba-bd56-46cc-8f70-9bd13d50d734 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:43.365171 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f93adba-bd56-46cc-8f70-9bd13d50d734 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:43.368637 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f93adba-bd56-46cc-8f70-9bd13d50d734 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:43.372552 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f93adba-bd56-46cc-8f70-9bd13d50d734 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:43.373721 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f93adba-bd56-46cc-8f70-9bd13d50d734 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:43.472894 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9f93adba-bd56-46cc-8f70-9bd13d50d734 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:26:43.562421 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:43.678665 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9f93adba-bd56-46cc-8f70-9bd13d50d734 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 204 len: 0 microversion: 2.1 time: 0.350359 Jul 25 16:26:43.680212 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 104/236] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:26:43 2022] DELETE /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:26:43.698938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-539a3454-f3ee-4af2-a129-2bef93106e75 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:43.709222 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-539a3454-f3ee-4af2-a129-2bef93106e75 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:43.709969 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-539a3454-f3ee-4af2-a129-2bef93106e75 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:43.853517 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-539a3454-f3ee-4af2-a129-2bef93106e75 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Going to try to stop instance {{(pid=117920) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:26:44.024601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-539a3454-f3ee-4af2-a129-2bef93106e75 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/action" status: 202 len: 0 microversion: 2.1 time: 0.336750 Jul 25 16:26:44.027103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 105/237] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:26:43 2022] POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:26:44.043035 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee017e09-8ebf-4f03-8085-5533b02abfaf tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:44.048512 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee017e09-8ebf-4f03-8085-5533b02abfaf tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:44.071190 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee017e09-8ebf-4f03-8085-5533b02abfaf tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:44.077532 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee017e09-8ebf-4f03-8085-5533b02abfaf tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:44.079090 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee017e09-8ebf-4f03-8085-5533b02abfaf tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:44.079761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee017e09-8ebf-4f03-8085-5533b02abfaf tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:44.201998 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b9e99948-82fd-4cfd-bdf7-8e1e58450344 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:44.253571 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b9e99948-82fd-4cfd-bdf7-8e1e58450344 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1515 microversion: 2.1 time: 1.347121 Jul 25 16:26:44.256993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 133/238] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:42 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1515 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:44.277933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3fa155e9-90a4-4630-8aa2-da2a58e5c2ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:44.285146 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3fa155e9-90a4-4630-8aa2-da2a58e5c2ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:44.302065 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fa155e9-90a4-4630-8aa2-da2a58e5c2ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:44.308885 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fa155e9-90a4-4630-8aa2-da2a58e5c2ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:44.313935 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fa155e9-90a4-4630-8aa2-da2a58e5c2ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:44.330665 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fa155e9-90a4-4630-8aa2-da2a58e5c2ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:45.310651 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee017e09-8ebf-4f03-8085-5533b02abfaf tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:45.333588 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee017e09-8ebf-4f03-8085-5533b02abfaf tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1503 microversion: 2.1 time: 1.304671 Jul 25 16:26:45.341485 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 106/239] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:44 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1503 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:45.464425 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3fa155e9-90a4-4630-8aa2-da2a58e5c2ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:45.547699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3fa155e9-90a4-4630-8aa2-da2a58e5c2ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1723 microversion: 2.1 time: 1.287008 Jul 25 16:26:45.548747 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 134/240] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:44 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1723 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:46.383045 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c34315fc-d518-4af5-8fd0-76698d1617d7 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:46.394872 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c34315fc-d518-4af5-8fd0-76698d1617d7 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:46.422938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34315fc-d518-4af5-8fd0-76698d1617d7 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.422938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34315fc-d518-4af5-8fd0-76698d1617d7 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.424287 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34315fc-d518-4af5-8fd0-76698d1617d7 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.425019 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c34315fc-d518-4af5-8fd0-76698d1617d7 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.574834 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-67238b25-4e12-4490-b501-285cd16c9d3e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:46.575617 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-67238b25-4e12-4490-b501-285cd16c9d3e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:46.588080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67238b25-4e12-4490-b501-285cd16c9d3e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.588581 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67238b25-4e12-4490-b501-285cd16c9d3e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.589534 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67238b25-4e12-4490-b501-285cd16c9d3e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.593432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-67238b25-4e12-4490-b501-285cd16c9d3e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:46.630686 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c34315fc-d518-4af5-8fd0-76698d1617d7 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:46.643392 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c34315fc-d518-4af5-8fd0-76698d1617d7 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1461 microversion: 2.1 time: 0.271974 Jul 25 16:26:46.648061 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 107/241] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:46 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1461 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:46.852905 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-67238b25-4e12-4490-b501-285cd16c9d3e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:46.869875 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-67238b25-4e12-4490-b501-285cd16c9d3e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1723 microversion: 2.1 time: 0.298651 Jul 25 16:26:46.887624 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 135/242] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:46 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:46.925983 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-cc5eaf32-f602-43a1-9502-b4d297377bc1 req-b097540b-58cd-4a09-8b73-e5a78bf6965b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd756e5e-ca84-457f-80c1-74f1d72aef9c", "name": "network-vif-deleted", "tag": "008cb211-79e5-4948-afe2-61340825b0e1"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:46.983529 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-cc5eaf32-f602-43a1-9502-b4d297377bc1 req-b097540b-58cd-4a09-8b73-e5a78bf6965b service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:46.985759 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-cc5eaf32-f602-43a1-9502-b4d297377bc1 req-b097540b-58cd-4a09-8b73-e5a78bf6965b service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:47.031174 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d408ba0c-e58a-4844-8a59-035e7d71d9b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'create', calling method: .version_select at 0x7f4410260d30>, body: {"keypair": {"name": "tempest-keypair-1833309268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGcYZI/vUL3o+IIwnO05K8MpiBrQiK7QGe31IlkWZvsLMO070lv6QsEk+TQ49WCJWFEH08VzIswsekjlZCJx6qmMlHkG/IjDqfK5bkTsWocGkBykOWvPFoXNKjNBKhnPjA=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:47.072892 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-d408ba0c-e58a-4844-8a59-035e7d71d9b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Getting quotas for project 18b6e0eaf4eb48868a683c7769d3df7a. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:26:47.085261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-d408ba0c-e58a-4844-8a59-035e7d71d9b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Getting quotas for user 2d1eb89923784f1c83d2077c6b6926e9 and project 18b6e0eaf4eb48868a683c7769d3df7a. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:26:47.156138 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d408ba0c-e58a-4844-8a59-035e7d71d9b2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129106 Jul 25 16:26:47.157772 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 136/243] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:26:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:47.380512 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-cc5eaf32-f602-43a1-9502-b4d297377bc1 req-b097540b-58cd-4a09-8b73-e5a78bf6965b service nova] Creating event network-vif-deleted:008cb211-79e5-4948-afe2-61340825b0e1 for instance bd756e5e-ca84-457f-80c1-74f1d72aef9c on hv-cinder-83697 Jul 25 16:26:47.391532 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-cc5eaf32-f602-43a1-9502-b4d297377bc1 req-b097540b-58cd-4a09-8b73-e5a78bf6965b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.473447 Jul 25 16:26:47.392208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 108/244] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:26:47.689917 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:47.694028 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:47.720627 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:47.722465 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:47.726139 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:47.728340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:47.856927 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:47.899303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b1ea5514-bb66-4849-8aab-0e08a6d3c496 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:47.902555 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b1ea5514-bb66-4849-8aab-0e08a6d3c496 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:47.913357 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ea5514-bb66-4849-8aab-0e08a6d3c496 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:47.914473 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ea5514-bb66-4849-8aab-0e08a6d3c496 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:47.916705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ea5514-bb66-4849-8aab-0e08a6d3c496 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:47.917808 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b1ea5514-bb66-4849-8aab-0e08a6d3c496 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:47.978081 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:47.979060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:47.980117 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lazy-loading 'fault' on Instance uuid bd756e5e-ca84-457f-80c1-74f1d72aef9c {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:26:48.287043 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb3927ae30c54149974d3037c1022854', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b1fba96612b4ed0ae53b43cdd4e3528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:48.312926 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2e8a8ff0-6a82-473c-a0a4-e807fb0ef978 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 200 len: 1303 microversion: 2.1 time: 0.632529 Jul 25 16:26:48.325877 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 137/245] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:47 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 1303 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:48.543920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b1ea5514-bb66-4849-8aab-0e08a6d3c496 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:48.561686 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b1ea5514-bb66-4849-8aab-0e08a6d3c496 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1723 microversion: 2.1 time: 0.671883 Jul 25 16:26:48.566567 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 109/246] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:47 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1723 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:49.360301 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:49.360301 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] [instance: bd756e5e-ca84-457f-80c1-74f1d72aef9c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:49.368971 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:49.369491 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:49.370429 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:49.376484 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:49.429024 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] HTTP exception thrown: Instance bd756e5e-ca84-457f-80c1-74f1d72aef9c could not be found. Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Request method failure captured: Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c HTTP/1.1 Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sQJzkyEGKxeKJADaAGEnXdoOdYoKzt_k99AET1Om7TvvJnZWAwu7_LcI4unvfWJ6FIUUrUsJsHYksoMR7bsfO1CSAoSH3smuJBWhcNizAH_h8h-KXAsmoAJbBjz1f1jnu_62l1iblpViq34pHQDFr2pX1MCr1ja3lzsILXIWMIkOKc Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 1b1fba96612b4ed0ae53b43cdd4e3528 Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesActionsTest-2115364438 Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:26:49.430854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1b1fba96612b4ed0ae53b43cdd4e3528"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b1fba96612b4ed0ae53b43cdd4e3528"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1b1fba96612b4ed0ae53b43cdd4e3528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1b1fba96612b4ed0ae53b43cdd4e3528"}]}] Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesActionsTest-2115364438 Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 1b1fba96612b4ed0ae53b43cdd4e3528 Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesActionsTest-2115364438 Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesActionsTest-2115364438-project Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: bb3927ae30c54149974d3037c1022854 Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesActionsTest-2115364438-project Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance bd756e5e-ca84-457f-80c1-74f1d72aef9c could not be found. Jul 25 16:26:49.433802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'bd756e5e-ca84-457f-80c1-74f1d72aef9c'} Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd756e5e-ca84-457f-80c1-74f1d72aef9c could not be found. Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:26:49.435482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd756e5e-ca84-457f-80c1-74f1d72aef9c could not be found. Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd756e5e-ca84-457f-80c1-74f1d72aef9c could not be found. Jul 25 16:26:49.439775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:26:49.441847 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] Returning 404 to user: Instance bd756e5e-ca84-457f-80c1-74f1d72aef9c could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:26:49.441847 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-902bbcd4-58fa-4239-b9fa-4e0962f2cc15 tempest-VolumesActionsTest-2115364438 tempest-VolumesActionsTest-2115364438-project] 10.222.0.66 "GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c" status: 404 len: 111 microversion: 2.1 time: 0.084574 Jul 25 16:26:49.482833 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 138/247] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:49 2022] GET /compute/v2.1/servers/bd756e5e-ca84-457f-80c1-74f1d72aef9c => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:26:49.631945 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a6539c14-6a88-4111-ae72-c364e03e95f6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:49.635106 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a6539c14-6a88-4111-ae72-c364e03e95f6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:49.667480 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6539c14-6a88-4111-ae72-c364e03e95f6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:49.670347 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6539c14-6a88-4111-ae72-c364e03e95f6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:49.672993 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6539c14-6a88-4111-ae72-c364e03e95f6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:49.677951 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a6539c14-6a88-4111-ae72-c364e03e95f6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:50.342770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a6539c14-6a88-4111-ae72-c364e03e95f6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:50.376703 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a6539c14-6a88-4111-ae72-c364e03e95f6 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1723 microversion: 2.1 time: 0.766702 Jul 25 16:26:50.379801 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 110/248] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:49 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1723 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:51.424908 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a5fda5ca-4dd9-4d32-a62b-198b7c484419 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:51.429462 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a5fda5ca-4dd9-4d32-a62b-198b7c484419 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:51.460529 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a5fda5ca-4dd9-4d32-a62b-198b7c484419 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:51.476433 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a5fda5ca-4dd9-4d32-a62b-198b7c484419 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:51.478294 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a5fda5ca-4dd9-4d32-a62b-198b7c484419 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:51.479893 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a5fda5ca-4dd9-4d32-a62b-198b7c484419 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:52.032353 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a5fda5ca-4dd9-4d32-a62b-198b7c484419 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:52.046487 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a5fda5ca-4dd9-4d32-a62b-198b7c484419 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1723 microversion: 2.1 time: 0.631292 Jul 25 16:26:52.049619 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 139/249] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:51 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1723 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:53.100664 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4f1e636a-eea4-467b-9e79-d2fe0a70cd33 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:53.106236 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4f1e636a-eea4-467b-9e79-d2fe0a70cd33 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:53.151907 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1e636a-eea4-467b-9e79-d2fe0a70cd33 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:53.153237 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1e636a-eea4-467b-9e79-d2fe0a70cd33 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:53.156097 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1e636a-eea4-467b-9e79-d2fe0a70cd33 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:53.157401 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4f1e636a-eea4-467b-9e79-d2fe0a70cd33 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:53.453408 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4f1e636a-eea4-467b-9e79-d2fe0a70cd33 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:53.479242 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4f1e636a-eea4-467b-9e79-d2fe0a70cd33 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1723 microversion: 2.1 time: 0.386804 Jul 25 16:26:53.495732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 111/250] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:53 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1723 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:54.181646 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-339882630", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ab96305-1028-4c5a-918e-429bbc4d3787"}], "security_groups": [{"name": "tempest-securitygroup--1124311427"}], "key_name": "tempest-keypair-1833309268", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:26:54.472433 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] validate_networks() for [('6ab96305-1028-4c5a-918e-429bbc4d3787', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:26:54.510127 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-35a3de12-6359-480b-88d9-ee494df5c285 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:54.511057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-35a3de12-6359-480b-88d9-ee494df5c285 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:54.526515 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35a3de12-6359-480b-88d9-ee494df5c285 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:54.527074 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35a3de12-6359-480b-88d9-ee494df5c285 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:54.529597 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35a3de12-6359-480b-88d9-ee494df5c285 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:54.530202 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-35a3de12-6359-480b-88d9-ee494df5c285 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:55.179626 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-35a3de12-6359-480b-88d9-ee494df5c285 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:55.192548 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-35a3de12-6359-480b-88d9-ee494df5c285 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1723 microversion: 2.1 time: 0.689170 Jul 25 16:26:55.195861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 112/251] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:54 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1723 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:56.130956 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:26:56.131636 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:26:56.131867 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:26:56.132196 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:26:56.132796 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:26:56.157217 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.157880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.159128 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.159803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.195004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Getting quotas for project 18b6e0eaf4eb48868a683c7769d3df7a. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:26:56.207204 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Getting quotas for user 2d1eb89923784f1c83d2077c6b6926e9 and project 18b6e0eaf4eb48868a683c7769d3df7a. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:26:56.230380 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7aaa702e-1e98-4eeb-8073-ff55067cb30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:56.235064 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7aaa702e-1e98-4eeb-8073-ff55067cb30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:56.237088 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:26:56.240216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:26:56.267094 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7aaa702e-1e98-4eeb-8073-ff55067cb30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.270191 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7aaa702e-1e98-4eeb-8073-ff55067cb30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.275409 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7aaa702e-1e98-4eeb-8073-ff55067cb30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:56.276664 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7aaa702e-1e98-4eeb-8073-ff55067cb30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:56.357686 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-780a6124-b243-46b2-822d-54be8e31f72e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.184190 Jul 25 16:26:56.358346 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 140/252] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:26:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 2186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 16:26:56.380265 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e44386f5-8255-459a-b989-3fd0a76241f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:56.383627 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e44386f5-8255-459a-b989-3fd0a76241f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:57.022957 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e44386f5-8255-459a-b989-3fd0a76241f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:57.045109 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e44386f5-8255-459a-b989-3fd0a76241f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1245 microversion: 2.1 time: 0.666746 Jul 25 16:26:57.046272 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 141/253] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:56 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1245 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:57.820816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7aaa702e-1e98-4eeb-8073-ff55067cb30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:57.831317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7aaa702e-1e98-4eeb-8073-ff55067cb30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1723 microversion: 2.1 time: 1.609939 Jul 25 16:26:57.848755 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 113/254] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:56 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1723 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:26:58.078030 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b4c418ae-32ed-4eee-9a14-b12064538b81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:58.079953 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b4c418ae-32ed-4eee-9a14-b12064538b81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:58.107210 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4c418ae-32ed-4eee-9a14-b12064538b81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.108544 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4c418ae-32ed-4eee-9a14-b12064538b81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:58.114283 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4c418ae-32ed-4eee-9a14-b12064538b81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.119012 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b4c418ae-32ed-4eee-9a14-b12064538b81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:58.539781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b4c418ae-32ed-4eee-9a14-b12064538b81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:26:58.554691 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b4c418ae-32ed-4eee-9a14-b12064538b81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1241 microversion: 2.1 time: 0.485873 Jul 25 16:26:58.565381 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 142/255] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:58 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1241 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:26:58.869530 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2f26c24b-c949-46a8-8dbc-317fa80840cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:58.871408 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2f26c24b-c949-46a8-8dbc-317fa80840cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:58.889803 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:26:58.900317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f26c24b-c949-46a8-8dbc-317fa80840cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.900317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f26c24b-c949-46a8-8dbc-317fa80840cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:58.900317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f26c24b-c949-46a8-8dbc-317fa80840cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:58.907560 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f26c24b-c949-46a8-8dbc-317fa80840cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:59.603239 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fe283daf-c3c0-4507-9f80-d3aa89484f76 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:26:59.618351 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fe283daf-c3c0-4507-9f80-d3aa89484f76 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:26:59.675881 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe283daf-c3c0-4507-9f80-d3aa89484f76 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:59.676503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe283daf-c3c0-4507-9f80-d3aa89484f76 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:26:59.683054 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe283daf-c3c0-4507-9f80-d3aa89484f76 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:26:59.687437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fe283daf-c3c0-4507-9f80-d3aa89484f76 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:00.078987 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2f26c24b-c949-46a8-8dbc-317fa80840cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:00.108941 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f26c24b-c949-46a8-8dbc-317fa80840cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1723 microversion: 2.1 time: 1.239258 Jul 25 16:27:00.110737 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 114/256] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:58 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1723 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:00.211706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fe283daf-c3c0-4507-9f80-d3aa89484f76 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:00.283008 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fe283daf-c3c0-4507-9f80-d3aa89484f76 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1303 microversion: 2.1 time: 0.695938 Jul 25 16:27:00.290903 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 143/257] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:26:59 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1303 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:01.155742 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-46e965c4-a34f-45df-9d97-9d9b6ef3c1df tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:01.157722 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-46e965c4-a34f-45df-9d97-9d9b6ef3c1df tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:01.187962 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46e965c4-a34f-45df-9d97-9d9b6ef3c1df tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:01.190797 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46e965c4-a34f-45df-9d97-9d9b6ef3c1df tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:01.206284 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46e965c4-a34f-45df-9d97-9d9b6ef3c1df tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:01.207038 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46e965c4-a34f-45df-9d97-9d9b6ef3c1df tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:01.313810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2bf6cf23-9460-4d7b-adb5-8b8b1f7fa90c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:01.315129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2bf6cf23-9460-4d7b-adb5-8b8b1f7fa90c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:01.363909 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2bf6cf23-9460-4d7b-adb5-8b8b1f7fa90c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:01.365121 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2bf6cf23-9460-4d7b-adb5-8b8b1f7fa90c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:01.373158 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2bf6cf23-9460-4d7b-adb5-8b8b1f7fa90c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:01.374122 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2bf6cf23-9460-4d7b-adb5-8b8b1f7fa90c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:02.014534 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46e965c4-a34f-45df-9d97-9d9b6ef3c1df tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:02.070985 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-46e965c4-a34f-45df-9d97-9d9b6ef3c1df tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1700 microversion: 2.1 time: 0.920736 Jul 25 16:27:02.071509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 115/258] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:01 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1700 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:02.103668 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-813b3022-8e28-4073-8660-68af11b95f38 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:02.126695 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-813b3022-8e28-4073-8660-68af11b95f38 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:02.127141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-813b3022-8e28-4073-8660-68af11b95f38 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:02.178791 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-813b3022-8e28-4073-8660-68af11b95f38 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Going to try to start instance {{(pid=117920) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 16:27:02.309664 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-813b3022-8e28-4073-8660-68af11b95f38 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/action" status: 202 len: 0 microversion: 2.1 time: 0.198273 Jul 25 16:27:02.310973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 116/259] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:27:02 2022] POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:27:02.322536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-349a737e-4552-43c9-9eba-fed40dd81ec5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:02.337096 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-349a737e-4552-43c9-9eba-fed40dd81ec5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:02.375413 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-349a737e-4552-43c9-9eba-fed40dd81ec5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:02.375878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-349a737e-4552-43c9-9eba-fed40dd81ec5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:02.381847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-349a737e-4552-43c9-9eba-fed40dd81ec5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:02.382359 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-349a737e-4552-43c9-9eba-fed40dd81ec5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:03.506252 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2bf6cf23-9460-4d7b-adb5-8b8b1f7fa90c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:03.516126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2bf6cf23-9460-4d7b-adb5-8b8b1f7fa90c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 2.207629 Jul 25 16:27:03.516747 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 144/260] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:01 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 2209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:03.669290 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-349a737e-4552-43c9-9eba-fed40dd81ec5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:03.723803 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-349a737e-4552-43c9-9eba-fed40dd81ec5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1709 microversion: 2.1 time: 1.403749 Jul 25 16:27:03.754023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 117/261] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:02 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1709 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:04.621374 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-04f04c67-68e9-4983-9b96-c235037d23d6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:04.622489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-04f04c67-68e9-4983-9b96-c235037d23d6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:04.635412 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:04.640219 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04f04c67-68e9-4983-9b96-c235037d23d6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:04.641512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04f04c67-68e9-4983-9b96-c235037d23d6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:04.643229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04f04c67-68e9-4983-9b96-c235037d23d6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:04.644376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04f04c67-68e9-4983-9b96-c235037d23d6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:04.769293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2137f4a3-55ae-4043-9fb9-948fc5b95f2c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:04.770354 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2137f4a3-55ae-4043-9fb9-948fc5b95f2c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:04.808200 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2137f4a3-55ae-4043-9fb9-948fc5b95f2c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:04.808985 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2137f4a3-55ae-4043-9fb9-948fc5b95f2c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:04.822397 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2137f4a3-55ae-4043-9fb9-948fc5b95f2c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:04.825455 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2137f4a3-55ae-4043-9fb9-948fc5b95f2c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:05.170016 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-04f04c67-68e9-4983-9b96-c235037d23d6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:05.227697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-04f04c67-68e9-4983-9b96-c235037d23d6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.677593 Jul 25 16:27:05.271897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 145/262] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:04 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:05.567675 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2137f4a3-55ae-4043-9fb9-948fc5b95f2c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:05.621732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2137f4a3-55ae-4043-9fb9-948fc5b95f2c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1709 microversion: 2.1 time: 0.859518 Jul 25 16:27:05.631359 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 118/263] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:04 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1709 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:06.275212 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-56f9c57d-9a59-4ea2-8739-99815f9c1ca2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:06.276772 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-56f9c57d-9a59-4ea2-8739-99815f9c1ca2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:06.280208 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:06.313472 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56f9c57d-9a59-4ea2-8739-99815f9c1ca2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:06.314252 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56f9c57d-9a59-4ea2-8739-99815f9c1ca2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:06.315662 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56f9c57d-9a59-4ea2-8739-99815f9c1ca2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:06.316412 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-56f9c57d-9a59-4ea2-8739-99815f9c1ca2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:06.666907 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a37fa15d-bc80-436e-a4c9-933a708c6bd5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:06.667857 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a37fa15d-bc80-436e-a4c9-933a708c6bd5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:06.696268 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a37fa15d-bc80-436e-a4c9-933a708c6bd5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:06.696705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a37fa15d-bc80-436e-a4c9-933a708c6bd5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:06.701650 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a37fa15d-bc80-436e-a4c9-933a708c6bd5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:06.706200 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a37fa15d-bc80-436e-a4c9-933a708c6bd5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:06.902685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-56f9c57d-9a59-4ea2-8739-99815f9c1ca2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:06.961330 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-56f9c57d-9a59-4ea2-8739-99815f9c1ca2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.695174 Jul 25 16:27:06.970251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 146/264] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:06 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:07.388733 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a37fa15d-bc80-436e-a4c9-933a708c6bd5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:07.404291 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a37fa15d-bc80-436e-a4c9-933a708c6bd5 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1709 microversion: 2.1 time: 0.742691 Jul 25 16:27:07.416051 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 119/265] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:06 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1709 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:07.988829 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-331eaf37-e4ce-4061-a3b9-1629769bdd23 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:07.991426 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-331eaf37-e4ce-4061-a3b9-1629769bdd23 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:08.008638 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=12 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:08.025551 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-331eaf37-e4ce-4061-a3b9-1629769bdd23 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:08.026976 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-331eaf37-e4ce-4061-a3b9-1629769bdd23 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:08.033934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-331eaf37-e4ce-4061-a3b9-1629769bdd23 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:08.034912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-331eaf37-e4ce-4061-a3b9-1629769bdd23 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:08.456596 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fb65bce8-b9e4-4d4f-a584-9c9f860db17c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:08.470033 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fb65bce8-b9e4-4d4f-a584-9c9f860db17c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:08.496763 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb65bce8-b9e4-4d4f-a584-9c9f860db17c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:08.500490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb65bce8-b9e4-4d4f-a584-9c9f860db17c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:08.514146 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb65bce8-b9e4-4d4f-a584-9c9f860db17c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:08.514967 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb65bce8-b9e4-4d4f-a584-9c9f860db17c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:08.697716 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:08.906680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-331eaf37-e4ce-4061-a3b9-1629769bdd23 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:08.980263 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-331eaf37-e4ce-4061-a3b9-1629769bdd23 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.998940 Jul 25 16:27:08.999244 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 147/266] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:07 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:09.601424 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-8f44ec21-c511-42b9-81d0-ae15a5206dd4 req-209952bf-ad1b-45c0-b84f-5ec3d30f119d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c107b-f645-476f-9b81-2dab0fedf218", "tag": "fb6733bd-e84d-4ca0-9190-079f0bc896c0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:09.644004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8f44ec21-c511-42b9-81d0-ae15a5206dd4 req-209952bf-ad1b-45c0-b84f-5ec3d30f119d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:09.645617 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8f44ec21-c511-42b9-81d0-ae15a5206dd4 req-209952bf-ad1b-45c0-b84f-5ec3d30f119d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:09.682276 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-8f44ec21-c511-42b9-81d0-ae15a5206dd4 req-209952bf-ad1b-45c0-b84f-5ec3d30f119d service nova] Creating event network-changed:fb6733bd-e84d-4ca0-9190-079f0bc896c0 for instance 931c107b-f645-476f-9b81-2dab0fedf218 on hv-cinder-83697 Jul 25 16:27:09.694808 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-8f44ec21-c511-42b9-81d0-ae15a5206dd4 req-209952bf-ad1b-45c0-b84f-5ec3d30f119d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098109 Jul 25 16:27:09.696666 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 148/267] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:27:10.036563 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-34b2c1e1-d3cf-4a4d-a0f2-2c477dc57154 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:10.037979 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-34b2c1e1-d3cf-4a4d-a0f2-2c477dc57154 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:10.097424 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34b2c1e1-d3cf-4a4d-a0f2-2c477dc57154 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:10.101389 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34b2c1e1-d3cf-4a4d-a0f2-2c477dc57154 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:10.107485 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34b2c1e1-d3cf-4a4d-a0f2-2c477dc57154 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:10.115337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34b2c1e1-d3cf-4a4d-a0f2-2c477dc57154 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:10.602682 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb65bce8-b9e4-4d4f-a584-9c9f860db17c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:10.654521 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fb65bce8-b9e4-4d4f-a584-9c9f860db17c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1709 microversion: 2.1 time: 2.209385 Jul 25 16:27:10.655620 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 120/268] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:08 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1709 bytes in 2212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:10.866483 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-34b2c1e1-d3cf-4a4d-a0f2-2c477dc57154 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:10.886609 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-34b2c1e1-d3cf-4a4d-a0f2-2c477dc57154 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.863416 Jul 25 16:27:10.888495 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 149/269] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:10 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:11.696366 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-da8c526e-c1e4-46d2-aceb-c8cb8562a2b7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:11.698139 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-da8c526e-c1e4-46d2-aceb-c8cb8562a2b7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:11.728105 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da8c526e-c1e4-46d2-aceb-c8cb8562a2b7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:11.729232 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da8c526e-c1e4-46d2-aceb-c8cb8562a2b7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:11.729635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da8c526e-c1e4-46d2-aceb-c8cb8562a2b7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:11.730212 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-da8c526e-c1e4-46d2-aceb-c8cb8562a2b7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:11.925510 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ee2105d4-5fc3-4d3f-8353-e0f7cc1ca53e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:11.928089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ee2105d4-5fc3-4d3f-8353-e0f7cc1ca53e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:11.992644 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ee2105d4-5fc3-4d3f-8353-e0f7cc1ca53e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:11.993603 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ee2105d4-5fc3-4d3f-8353-e0f7cc1ca53e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:11.994871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ee2105d4-5fc3-4d3f-8353-e0f7cc1ca53e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:11.995588 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ee2105d4-5fc3-4d3f-8353-e0f7cc1ca53e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:12.581901 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-da8c526e-c1e4-46d2-aceb-c8cb8562a2b7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:12.625678 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-da8c526e-c1e4-46d2-aceb-c8cb8562a2b7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1713 microversion: 2.1 time: 0.933595 Jul 25 16:27:12.627065 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 121/270] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:11 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1713 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:13.012150 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ee2105d4-5fc3-4d3f-8353-e0f7cc1ca53e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:13.025565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ee2105d4-5fc3-4d3f-8353-e0f7cc1ca53e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 1.106289 Jul 25 16:27:13.042841 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 150/271] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:11 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:14.063981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-386f5e91-ee2c-4f0f-9326-dc39f4ba6893 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:14.067712 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-386f5e91-ee2c-4f0f-9326-dc39f4ba6893 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:14.120454 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386f5e91-ee2c-4f0f-9326-dc39f4ba6893 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:14.122169 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386f5e91-ee2c-4f0f-9326-dc39f4ba6893 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:14.124475 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386f5e91-ee2c-4f0f-9326-dc39f4ba6893 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:14.125565 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-386f5e91-ee2c-4f0f-9326-dc39f4ba6893 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:14.689794 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-386f5e91-ee2c-4f0f-9326-dc39f4ba6893 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:14.709783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-386f5e91-ee2c-4f0f-9326-dc39f4ba6893 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.653603 Jul 25 16:27:14.711554 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 122/272] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:14 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:15.762933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-44ac6554-93f2-44bd-a04b-154c136cea36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:15.765950 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-44ac6554-93f2-44bd-a04b-154c136cea36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:15.787638 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-44ac6554-93f2-44bd-a04b-154c136cea36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:15.795695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-44ac6554-93f2-44bd-a04b-154c136cea36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:15.797883 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-44ac6554-93f2-44bd-a04b-154c136cea36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:15.800828 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-44ac6554-93f2-44bd-a04b-154c136cea36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:15.834286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-618942490", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "networks": [{"uuid": "fbc95ce4-7af4-4dc6-9cb6-7699309ac513"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:16.446116 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-44ac6554-93f2-44bd-a04b-154c136cea36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:16.476098 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-44ac6554-93f2-44bd-a04b-154c136cea36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.730764 Jul 25 16:27:16.481133 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 151/273] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:15 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:17.504399 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-21588278-f869-4ec3-9f4b-4fa37c3fcffb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:17.505955 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-21588278-f869-4ec3-9f4b-4fa37c3fcffb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:17.519553 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21588278-f869-4ec3-9f4b-4fa37c3fcffb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:17.522113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21588278-f869-4ec3-9f4b-4fa37c3fcffb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:17.525485 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21588278-f869-4ec3-9f4b-4fa37c3fcffb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:17.538307 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21588278-f869-4ec3-9f4b-4fa37c3fcffb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:17.916396 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-21588278-f869-4ec3-9f4b-4fa37c3fcffb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:17.935824 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=76 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:17.984468 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-21588278-f869-4ec3-9f4b-4fa37c3fcffb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.475770 Jul 25 16:27:17.992384 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 152/274] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:17 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:18.895914 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-e339b535-7e85-4868-beb7-a20cf91a0f42 req-360e7535-08f0-421d-8ccb-37c054e2ec35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931c107b-f645-476f-9b81-2dab0fedf218", "name": "network-vif-plugged", "status": "completed", "tag": "fb6733bd-e84d-4ca0-9190-079f0bc896c0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:18.943115 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e339b535-7e85-4868-beb7-a20cf91a0f42 req-360e7535-08f0-421d-8ccb-37c054e2ec35 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:18.947436 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e339b535-7e85-4868-beb7-a20cf91a0f42 req-360e7535-08f0-421d-8ccb-37c054e2ec35 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:19.064854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-e339b535-7e85-4868-beb7-a20cf91a0f42 req-360e7535-08f0-421d-8ccb-37c054e2ec35 service nova] Creating event network-vif-plugged:fb6733bd-e84d-4ca0-9190-079f0bc896c0 for instance 931c107b-f645-476f-9b81-2dab0fedf218 on hv-cinder-83697 Jul 25 16:27:19.087448 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-e339b535-7e85-4868-beb7-a20cf91a0f42 req-360e7535-08f0-421d-8ccb-37c054e2ec35 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199209 Jul 25 16:27:19.090330 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 153/275] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:27:19.111919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1240ea7d-8cbf-4276-b247-a57a55b4ddb4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:19.121979 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1240ea7d-8cbf-4276-b247-a57a55b4ddb4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:19.142148 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1240ea7d-8cbf-4276-b247-a57a55b4ddb4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:19.145743 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1240ea7d-8cbf-4276-b247-a57a55b4ddb4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:19.148762 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1240ea7d-8cbf-4276-b247-a57a55b4ddb4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:19.149821 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1240ea7d-8cbf-4276-b247-a57a55b4ddb4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:19.555327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1240ea7d-8cbf-4276-b247-a57a55b4ddb4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:19.571142 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1240ea7d-8cbf-4276-b247-a57a55b4ddb4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.478513 Jul 25 16:27:19.589899 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 154/276] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:19 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:20.604595 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-034102da-838b-4ebb-aa8c-1b752bfd71bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:20.605445 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-034102da-838b-4ebb-aa8c-1b752bfd71bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:20.625970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-034102da-838b-4ebb-aa8c-1b752bfd71bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:20.626867 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-034102da-838b-4ebb-aa8c-1b752bfd71bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:20.628010 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-034102da-838b-4ebb-aa8c-1b752bfd71bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:20.628676 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-034102da-838b-4ebb-aa8c-1b752bfd71bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:21.042420 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-034102da-838b-4ebb-aa8c-1b752bfd71bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:21.068289 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-034102da-838b-4ebb-aa8c-1b752bfd71bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.468057 Jul 25 16:27:21.083606 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 155/277] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:20 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:22.110017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-32b0a6ec-bd99-41a5-b3cb-2d4fa6a54ef2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:22.113187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-32b0a6ec-bd99-41a5-b3cb-2d4fa6a54ef2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:22.166703 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32b0a6ec-bd99-41a5-b3cb-2d4fa6a54ef2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:22.167883 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32b0a6ec-bd99-41a5-b3cb-2d4fa6a54ef2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:22.170970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32b0a6ec-bd99-41a5-b3cb-2d4fa6a54ef2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:22.174898 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32b0a6ec-bd99-41a5-b3cb-2d4fa6a54ef2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:22.581838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-32b0a6ec-bd99-41a5-b3cb-2d4fa6a54ef2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:22.600471 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-32b0a6ec-bd99-41a5-b3cb-2d4fa6a54ef2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.500587 Jul 25 16:27:22.601831 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 156/278] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:22 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:23.657128 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0e73bcea-db73-4299-be56-81c837ab4e41 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:23.660986 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0e73bcea-db73-4299-be56-81c837ab4e41 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:23.674725 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e73bcea-db73-4299-be56-81c837ab4e41 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:23.676492 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e73bcea-db73-4299-be56-81c837ab4e41 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:23.678466 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e73bcea-db73-4299-be56-81c837ab4e41 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:23.679665 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e73bcea-db73-4299-be56-81c837ab4e41 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:24.001029 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0e73bcea-db73-4299-be56-81c837ab4e41 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:24.019125 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0e73bcea-db73-4299-be56-81c837ab4e41 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1371 microversion: 2.1 time: 0.381754 Jul 25 16:27:24.033396 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 157/279] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:23 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1371 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:24.701311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=17 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:25.086229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e3091073-1863-47f2-833e-37fe9b13e8ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:25.092797 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e3091073-1863-47f2-833e-37fe9b13e8ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:25.155863 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e3091073-1863-47f2-833e-37fe9b13e8ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:25.163357 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e3091073-1863-47f2-833e-37fe9b13e8ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:25.165816 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e3091073-1863-47f2-833e-37fe9b13e8ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:25.167185 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e3091073-1863-47f2-833e-37fe9b13e8ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:25.545999 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e3091073-1863-47f2-833e-37fe9b13e8ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:25.577246 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e3091073-1863-47f2-833e-37fe9b13e8ab tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1566 microversion: 2.1 time: 0.523895 Jul 25 16:27:25.578617 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 158/280] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:25 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1566 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:25.608787 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9ce96c23-7ade-4601-b8ef-4776a10174af tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:25.611788 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9ce96c23-7ade-4601-b8ef-4776a10174af tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:25.636994 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9ce96c23-7ade-4601-b8ef-4776a10174af tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:25.636994 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9ce96c23-7ade-4601-b8ef-4776a10174af tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:25.639083 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9ce96c23-7ade-4601-b8ef-4776a10174af tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:25.639942 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9ce96c23-7ade-4601-b8ef-4776a10174af tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:25.783815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9ce96c23-7ade-4601-b8ef-4776a10174af tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177048 Jul 25 16:27:25.785582 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 159/281] 10.222.0.66 () {58 vars in 1275 bytes} [Mon Jul 25 16:27:25 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:25.931218 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=19 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:27.279048 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b257115-5106-40fd-a788-314cd0451c06 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Action: 'create', calling method: .version_select at 0x7f44101959d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1810918726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIw4iXVYGzSpkOtfMDCFkyY4Mullt80QcEJAs4HaGI7j2bDLnvrBEGHwq33JT3Kqexb6jvrHA5/tpiYXdLQ58bimzpC/4sZnI6N9eOVLXh/pLwP3qlzMc1WK6cSguQwnYA=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:27.322912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-7b257115-5106-40fd-a788-314cd0451c06 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Getting quotas for project 966cf8bbbc4540a596f615498331465a. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:27:27.330787 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-7b257115-5106-40fd-a788-314cd0451c06 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Getting quotas for user 55d7bbda47b64493a840fef8c6c40431 and project 966cf8bbbc4540a596f615498331465a. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:27:27.375499 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b257115-5106-40fd-a788-314cd0451c06 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.103873 Jul 25 16:27:27.394096 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 160/282] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:27:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:27.605106 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] validate_networks() for [('fbc95ce4-7af4-4dc6-9cb6-7699309ac513', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:27:27.671603 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-559997230", "imageRef": "e2a10525-8467-4e1a-968b-98fd5c86e717", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1810918726", "networks": [{"uuid": "8b4b1c3c-0e0d-48d5-b8f1-2198c4fff6b6"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:27.770606 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] validate_networks() for [('8b4b1c3c-0e0d-48d5-b8f1-2198c4fff6b6', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:27:28.993292 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:27:28.995713 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:27:28.996937 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:27:28.998159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:27:28.999149 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:27:29.049484 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:27:29.050636 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:27:29.051426 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:27:29.052652 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:27:29.053607 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.054251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:27:29.055610 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.061077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.066889 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.078617 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.079407 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.081483 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.082210 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.147438 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Getting quotas for project 966cf8bbbc4540a596f615498331465a. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:27:29.165806 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Getting quotas for user 55d7bbda47b64493a840fef8c6c40431 and project 966cf8bbbc4540a596f615498331465a. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:27:29.169401 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Getting quotas for project bd9b5f7127564335a847ab40761124df. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:27:29.182591 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Getting quotas for user c7e1898925cd4feea900627bc0ee8a7a and project bd9b5f7127564335a847ab40761124df. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:27:29.231660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:27:29.244261 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:27:29.249093 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2a10525-8467-4e1a-968b-98fd5c86e717',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:27:29.256660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:27:29.406764 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2ede6bc2-e980-4ebb-afd1-f88eb8126735 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.746948 Jul 25 16:27:29.422961 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 161/283] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:27:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:27:29.442167 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-12d2aa3c-cf95-4897-be2f-001637ac88fc req-c7af9395-a929-46ba-b937-41e5ae5e1cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c107b-f645-476f-9b81-2dab0fedf218", "tag": "fb6733bd-e84d-4ca0-9190-079f0bc896c0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:29.467724 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-12d2aa3c-cf95-4897-be2f-001637ac88fc req-c7af9395-a929-46ba-b937-41e5ae5e1cea service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:29.478650 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-12d2aa3c-cf95-4897-be2f-001637ac88fc req-c7af9395-a929-46ba-b937-41e5ae5e1cea service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:29.531644 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-12d2aa3c-cf95-4897-be2f-001637ac88fc req-c7af9395-a929-46ba-b937-41e5ae5e1cea service nova] Creating event network-changed:fb6733bd-e84d-4ca0-9190-079f0bc896c0 for instance 931c107b-f645-476f-9b81-2dab0fedf218 on hv-cinder-83697 Jul 25 16:27:29.559698 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-12d2aa3c-cf95-4897-be2f-001637ac88fc req-c7af9395-a929-46ba-b937-41e5ae5e1cea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132633 Jul 25 16:27:29.561967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 162/284] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:29.574655 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-82123fa3-1941-4c29-8d14-f50941ba7261 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:29.576321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-82123fa3-1941-4c29-8d14-f50941ba7261 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:29.640894 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c4c08518-88bf-47a7-b4d8-fcabd66e7191 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.813857 Jul 25 16:27:29.670959 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 123/285] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 13845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:27:29.711038 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8b22845a-7e0a-4ed5-9190-db799e293187 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:29.711662 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-82123fa3-1941-4c29-8d14-f50941ba7261 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:29.712141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8b22845a-7e0a-4ed5-9190-db799e293187 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:29.724874 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-82123fa3-1941-4c29-8d14-f50941ba7261 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1258 microversion: 2.1 time: 0.160152 Jul 25 16:27:29.730297 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 163/286] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:29 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:29.939038 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b22845a-7e0a-4ed5-9190-db799e293187 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:29.985229 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8b22845a-7e0a-4ed5-9190-db799e293187 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1218 microversion: 2.1 time: 0.306452 Jul 25 16:27:30.005907 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 124/287] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:29 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1218 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:30.786651 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-20cb6ee0-f142-4922-b63f-6345800130f1 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:30.787828 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-20cb6ee0-f142-4922-b63f-6345800130f1 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:30.877631 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20cb6ee0-f142-4922-b63f-6345800130f1 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:30.881914 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20cb6ee0-f142-4922-b63f-6345800130f1 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:30.891964 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20cb6ee0-f142-4922-b63f-6345800130f1 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:30.893002 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-20cb6ee0-f142-4922-b63f-6345800130f1 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:31.091458 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-48b8288c-a4de-425b-9069-868aaa8aee6b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:31.093947 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-48b8288c-a4de-425b-9069-868aaa8aee6b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:31.122594 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48b8288c-a4de-425b-9069-868aaa8aee6b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:31.126123 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48b8288c-a4de-425b-9069-868aaa8aee6b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:31.128149 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48b8288c-a4de-425b-9069-868aaa8aee6b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:31.129297 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-48b8288c-a4de-425b-9069-868aaa8aee6b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:31.197113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-20cb6ee0-f142-4922-b63f-6345800130f1 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:31.210664 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-20cb6ee0-f142-4922-b63f-6345800130f1 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1262 microversion: 2.1 time: 0.438191 Jul 25 16:27:31.211122 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 164/288] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:30 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1262 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:31.351365 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-48b8288c-a4de-425b-9069-868aaa8aee6b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:31.404084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-48b8288c-a4de-425b-9069-868aaa8aee6b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1222 microversion: 2.1 time: 0.359083 Jul 25 16:27:31.428534 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 125/289] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:31 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1222 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:32.252117 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-343e7048-0d86-4f70-9c32-9f5f412a960a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:32.253152 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-343e7048-0d86-4f70-9c32-9f5f412a960a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:32.283227 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-343e7048-0d86-4f70-9c32-9f5f412a960a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:32.285038 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-343e7048-0d86-4f70-9c32-9f5f412a960a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:32.287072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-343e7048-0d86-4f70-9c32-9f5f412a960a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:32.288257 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-343e7048-0d86-4f70-9c32-9f5f412a960a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:32.417601 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-343e7048-0d86-4f70-9c32-9f5f412a960a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:32.432481 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-343e7048-0d86-4f70-9c32-9f5f412a960a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1310 microversion: 2.1 time: 0.187558 Jul 25 16:27:32.435253 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 165/290] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:32 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1310 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:32.456304 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-93ec4730-b8ab-4367-b459-9ec9ef089f27 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:32.458136 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-93ec4730-b8ab-4367-b459-9ec9ef089f27 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:32.471245 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93ec4730-b8ab-4367-b459-9ec9ef089f27 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:32.472561 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93ec4730-b8ab-4367-b459-9ec9ef089f27 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:32.474005 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93ec4730-b8ab-4367-b459-9ec9ef089f27 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:32.474639 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93ec4730-b8ab-4367-b459-9ec9ef089f27 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:32.615489 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93ec4730-b8ab-4367-b459-9ec9ef089f27 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:32.627163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-93ec4730-b8ab-4367-b459-9ec9ef089f27 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1270 microversion: 2.1 time: 0.185294 Jul 25 16:27:32.677189 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 126/291] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:32 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1270 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:33.472027 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-518636be-9d6c-4946-9169-fad4ba55bc2c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:33.475322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-518636be-9d6c-4946-9169-fad4ba55bc2c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:33.497207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-518636be-9d6c-4946-9169-fad4ba55bc2c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:33.499018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-518636be-9d6c-4946-9169-fad4ba55bc2c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:33.506729 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-518636be-9d6c-4946-9169-fad4ba55bc2c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:33.509281 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-518636be-9d6c-4946-9169-fad4ba55bc2c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:33.663677 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c07523b0-3a76-411b-8893-c4a825d4b833 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:33.664472 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c07523b0-3a76-411b-8893-c4a825d4b833 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:33.691293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c07523b0-3a76-411b-8893-c4a825d4b833 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:33.691293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c07523b0-3a76-411b-8893-c4a825d4b833 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:33.691293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c07523b0-3a76-411b-8893-c4a825d4b833 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:33.691293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c07523b0-3a76-411b-8893-c4a825d4b833 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:33.692493 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-518636be-9d6c-4946-9169-fad4ba55bc2c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:33.696593 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-518636be-9d6c-4946-9169-fad4ba55bc2c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1310 microversion: 2.1 time: 0.233524 Jul 25 16:27:33.697404 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 166/292] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:33 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1310 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:33.783384 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c07523b0-3a76-411b-8893-c4a825d4b833 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:33.794013 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c07523b0-3a76-411b-8893-c4a825d4b833 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1278 microversion: 2.1 time: 0.135450 Jul 25 16:27:33.795014 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 127/293] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:33 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:34.721191 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c43508d1-439c-4f99-909a-48ed91df9e47 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:34.722165 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c43508d1-439c-4f99-909a-48ed91df9e47 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:34.724704 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:34.733408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c43508d1-439c-4f99-909a-48ed91df9e47 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:34.734485 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c43508d1-439c-4f99-909a-48ed91df9e47 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:34.735924 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c43508d1-439c-4f99-909a-48ed91df9e47 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:34.736688 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c43508d1-439c-4f99-909a-48ed91df9e47 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:34.832630 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c43508d1-439c-4f99-909a-48ed91df9e47 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:34.837049 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-970b9162-3998-4945-b5df-5bcb177a5ba3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:34.838136 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-970b9162-3998-4945-b5df-5bcb177a5ba3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:34.844702 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c43508d1-439c-4f99-909a-48ed91df9e47 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1310 microversion: 2.1 time: 0.127950 Jul 25 16:27:34.850780 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-970b9162-3998-4945-b5df-5bcb177a5ba3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:34.851477 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-970b9162-3998-4945-b5df-5bcb177a5ba3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:34.852528 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-970b9162-3998-4945-b5df-5bcb177a5ba3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:34.853795 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-970b9162-3998-4945-b5df-5bcb177a5ba3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:34.860102 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 167/294] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:34 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1310 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:34.953797 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-970b9162-3998-4945-b5df-5bcb177a5ba3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:34.966761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-970b9162-3998-4945-b5df-5bcb177a5ba3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1288 microversion: 2.1 time: 0.136368 Jul 25 16:27:34.967912 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 128/295] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:34 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1288 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:35.873648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4754facf-3968-4190-ac04-a3b8135d4a22 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:35.874734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4754facf-3968-4190-ac04-a3b8135d4a22 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:35.885664 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4754facf-3968-4190-ac04-a3b8135d4a22 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:35.886455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4754facf-3968-4190-ac04-a3b8135d4a22 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:35.887966 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4754facf-3968-4190-ac04-a3b8135d4a22 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:35.888783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4754facf-3968-4190-ac04-a3b8135d4a22 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:35.978877 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4754facf-3968-4190-ac04-a3b8135d4a22 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:35.989530 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4754facf-3968-4190-ac04-a3b8135d4a22 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1328 microversion: 2.1 time: 0.122142 Jul 25 16:27:35.990129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 168/296] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:35 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:36.006554 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7290fe84-5366-413c-a653-dceee203f084 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:36.006554 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7290fe84-5366-413c-a653-dceee203f084 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:36.015281 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7290fe84-5366-413c-a653-dceee203f084 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:36.016219 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7290fe84-5366-413c-a653-dceee203f084 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:36.017407 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7290fe84-5366-413c-a653-dceee203f084 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:36.018095 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7290fe84-5366-413c-a653-dceee203f084 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:36.152727 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7290fe84-5366-413c-a653-dceee203f084 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:36.164615 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7290fe84-5366-413c-a653-dceee203f084 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1276 microversion: 2.1 time: 0.166420 Jul 25 16:27:36.165770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 129/297] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:35 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:37.020392 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9f9d0070-6006-4115-a9c9-fd1429267e02 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:37.022649 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9f9d0070-6006-4115-a9c9-fd1429267e02 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:37.036767 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f9d0070-6006-4115-a9c9-fd1429267e02 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:37.038497 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f9d0070-6006-4115-a9c9-fd1429267e02 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:37.040494 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f9d0070-6006-4115-a9c9-fd1429267e02 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:37.041745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9f9d0070-6006-4115-a9c9-fd1429267e02 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:37.195513 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bd709c5-7431-4cb8-9424-3a762f4ba21d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:37.212419 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1bd709c5-7431-4cb8-9424-3a762f4ba21d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:37.253396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd709c5-7431-4cb8-9424-3a762f4ba21d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:37.254407 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd709c5-7431-4cb8-9424-3a762f4ba21d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:37.259283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd709c5-7431-4cb8-9424-3a762f4ba21d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:37.267839 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bd709c5-7431-4cb8-9424-3a762f4ba21d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:37.762516 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9f9d0070-6006-4115-a9c9-fd1429267e02 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:37.794242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9f9d0070-6006-4115-a9c9-fd1429267e02 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1316 microversion: 2.1 time: 0.782748 Jul 25 16:27:37.797761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 169/298] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:37 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1316 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:38.035639 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1bd709c5-7431-4cb8-9424-3a762f4ba21d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:38.050132 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1bd709c5-7431-4cb8-9424-3a762f4ba21d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.864609 Jul 25 16:27:38.069086 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 130/299] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:37 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:38.834024 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b07ce8d6-8bf0-4494-a38b-a32383a003a6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:38.837502 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b07ce8d6-8bf0-4494-a38b-a32383a003a6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:38.847626 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b07ce8d6-8bf0-4494-a38b-a32383a003a6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:38.849010 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b07ce8d6-8bf0-4494-a38b-a32383a003a6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:38.850259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b07ce8d6-8bf0-4494-a38b-a32383a003a6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:38.850983 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b07ce8d6-8bf0-4494-a38b-a32383a003a6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:39.082232 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-18573321-defd-4bab-b35d-143f88598743 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:39.084588 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-18573321-defd-4bab-b35d-143f88598743 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:39.094138 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:39.105072 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18573321-defd-4bab-b35d-143f88598743 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:39.105709 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18573321-defd-4bab-b35d-143f88598743 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:39.106652 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18573321-defd-4bab-b35d-143f88598743 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:39.107382 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-18573321-defd-4bab-b35d-143f88598743 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:39.174314 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:39.401241 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b07ce8d6-8bf0-4494-a38b-a32383a003a6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:39.421161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b07ce8d6-8bf0-4494-a38b-a32383a003a6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.600630 Jul 25 16:27:39.438807 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 170/300] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:38 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:39.570506 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-18573321-defd-4bab-b35d-143f88598743 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:39.584553 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-18573321-defd-4bab-b35d-143f88598743 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.507114 Jul 25 16:27:39.601993 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 131/301] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:39 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:39.755336 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-bb5100f6-c294-45d1-bd14-da4644889a67 req-73cec3fc-8a53-455f-a20d-96903ccf3ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e15a0f-ed99-4348-98a3-10a6a91e7d3c", "tag": "c088b66c-9e47-45df-a77e-878bab58d1aa"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:39.775302 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=12 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:39.786969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-bb5100f6-c294-45d1-bd14-da4644889a67 req-73cec3fc-8a53-455f-a20d-96903ccf3ad0 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:39.788134 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-bb5100f6-c294-45d1-bd14-da4644889a67 req-73cec3fc-8a53-455f-a20d-96903ccf3ad0 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:39.810480 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-bb5100f6-c294-45d1-bd14-da4644889a67 req-73cec3fc-8a53-455f-a20d-96903ccf3ad0 service nova] Creating event network-changed:c088b66c-9e47-45df-a77e-878bab58d1aa for instance c7e15a0f-ed99-4348-98a3-10a6a91e7d3c on hv-cinder-83697 Jul 25 16:27:39.832948 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-bb5100f6-c294-45d1-bd14-da4644889a67 req-73cec3fc-8a53-455f-a20d-96903ccf3ad0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084587 Jul 25 16:27:39.834390 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 171/302] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:40.454702 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a9465472-d6c2-4754-8b4b-623e0ed8956c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:40.456472 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a9465472-d6c2-4754-8b4b-623e0ed8956c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:40.458947 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=8 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:40.467348 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9465472-d6c2-4754-8b4b-623e0ed8956c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:40.468784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9465472-d6c2-4754-8b4b-623e0ed8956c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:40.470240 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9465472-d6c2-4754-8b4b-623e0ed8956c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:40.470866 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9465472-d6c2-4754-8b4b-623e0ed8956c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:40.614294 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ae2c9097-884f-43a5-88af-3bc0e03c92bf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:40.615770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ae2c9097-884f-43a5-88af-3bc0e03c92bf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:40.631321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae2c9097-884f-43a5-88af-3bc0e03c92bf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:40.632151 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae2c9097-884f-43a5-88af-3bc0e03c92bf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:40.633010 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae2c9097-884f-43a5-88af-3bc0e03c92bf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:40.633561 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ae2c9097-884f-43a5-88af-3bc0e03c92bf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:40.713753 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a9465472-d6c2-4754-8b4b-623e0ed8956c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:40.727895 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a9465472-d6c2-4754-8b4b-623e0ed8956c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.283681 Jul 25 16:27:40.742033 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 132/303] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:40 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:40.939078 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ae2c9097-884f-43a5-88af-3bc0e03c92bf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:40.960911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ae2c9097-884f-43a5-88af-3bc0e03c92bf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.354030 Jul 25 16:27:40.963057 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 172/304] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:40 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:41.769752 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-29eb7b92-6d28-4816-9f45-ea1ba5ee5f80 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:41.771519 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-29eb7b92-6d28-4816-9f45-ea1ba5ee5f80 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:41.782676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29eb7b92-6d28-4816-9f45-ea1ba5ee5f80 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:41.783399 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29eb7b92-6d28-4816-9f45-ea1ba5ee5f80 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:41.784761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29eb7b92-6d28-4816-9f45-ea1ba5ee5f80 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:41.785518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-29eb7b92-6d28-4816-9f45-ea1ba5ee5f80 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:42.012841 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0fa0f3de-4403-43b9-97cc-fac4914b3258 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:42.022690 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0fa0f3de-4403-43b9-97cc-fac4914b3258 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:42.037245 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fa0f3de-4403-43b9-97cc-fac4914b3258 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:42.038658 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fa0f3de-4403-43b9-97cc-fac4914b3258 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:42.040616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fa0f3de-4403-43b9-97cc-fac4914b3258 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:42.041934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0fa0f3de-4403-43b9-97cc-fac4914b3258 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:42.068935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-29eb7b92-6d28-4816-9f45-ea1ba5ee5f80 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:42.079874 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-29eb7b92-6d28-4816-9f45-ea1ba5ee5f80 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.318243 Jul 25 16:27:42.081713 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 133/305] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:41 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:42.367115 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0fa0f3de-4403-43b9-97cc-fac4914b3258 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:42.377152 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0fa0f3de-4403-43b9-97cc-fac4914b3258 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.371984 Jul 25 16:27:42.389813 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 173/306] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:42 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:43.115982 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-58c9cbee-c1bd-4131-b1e6-9d8239e22c92 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:43.116885 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-58c9cbee-c1bd-4131-b1e6-9d8239e22c92 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:43.130227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c9cbee-c1bd-4131-b1e6-9d8239e22c92 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:43.131067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c9cbee-c1bd-4131-b1e6-9d8239e22c92 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:43.132473 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c9cbee-c1bd-4131-b1e6-9d8239e22c92 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:43.133498 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-58c9cbee-c1bd-4131-b1e6-9d8239e22c92 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:43.401384 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fdd3eaa1-03bd-4e3d-aba9-08370624a8e1 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:43.402720 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fdd3eaa1-03bd-4e3d-aba9-08370624a8e1 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:43.409697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fdd3eaa1-03bd-4e3d-aba9-08370624a8e1 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:43.410523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fdd3eaa1-03bd-4e3d-aba9-08370624a8e1 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:43.411567 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fdd3eaa1-03bd-4e3d-aba9-08370624a8e1 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:43.412224 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fdd3eaa1-03bd-4e3d-aba9-08370624a8e1 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:43.445612 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:43.604984 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-58c9cbee-c1bd-4131-b1e6-9d8239e22c92 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:43.624121 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-58c9cbee-c1bd-4131-b1e6-9d8239e22c92 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.513351 Jul 25 16:27:43.624739 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 134/307] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:43 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:43.841433 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fdd3eaa1-03bd-4e3d-aba9-08370624a8e1 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:43.879102 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fdd3eaa1-03bd-4e3d-aba9-08370624a8e1 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.481416 Jul 25 16:27:43.884199 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 174/308] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:43 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:44.663465 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-093bdd43-d638-456c-b307-f2f65071252a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:44.666011 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-093bdd43-d638-456c-b307-f2f65071252a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:44.677889 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093bdd43-d638-456c-b307-f2f65071252a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:44.679063 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093bdd43-d638-456c-b307-f2f65071252a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:44.680474 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093bdd43-d638-456c-b307-f2f65071252a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:44.681936 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-093bdd43-d638-456c-b307-f2f65071252a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:44.926288 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c11be4f0-1ab1-48d2-ae8d-ab98a7481024 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:44.927637 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c11be4f0-1ab1-48d2-ae8d-ab98a7481024 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:44.938849 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c11be4f0-1ab1-48d2-ae8d-ab98a7481024 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:44.943591 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c11be4f0-1ab1-48d2-ae8d-ab98a7481024 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:44.946431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c11be4f0-1ab1-48d2-ae8d-ab98a7481024 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:44.949495 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c11be4f0-1ab1-48d2-ae8d-ab98a7481024 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:44.990651 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-093bdd43-d638-456c-b307-f2f65071252a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:45.003860 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-093bdd43-d638-456c-b307-f2f65071252a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.345938 Jul 25 16:27:45.005286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 135/309] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:44 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:45.247386 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c11be4f0-1ab1-48d2-ae8d-ab98a7481024 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:45.270512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c11be4f0-1ab1-48d2-ae8d-ab98a7481024 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.347788 Jul 25 16:27:45.271245 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 175/310] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:44 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:46.041843 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23f39828-3c70-49bd-a49e-86c5c1540c79 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:46.044115 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23f39828-3c70-49bd-a49e-86c5c1540c79 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:46.056010 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f39828-3c70-49bd-a49e-86c5c1540c79 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:46.057033 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f39828-3c70-49bd-a49e-86c5c1540c79 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:46.058510 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f39828-3c70-49bd-a49e-86c5c1540c79 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:46.059644 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23f39828-3c70-49bd-a49e-86c5c1540c79 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:46.294370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b2421578-f437-4a40-8bfd-23caab763696 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:46.296800 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b2421578-f437-4a40-8bfd-23caab763696 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:46.315499 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b2421578-f437-4a40-8bfd-23caab763696 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:46.317475 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b2421578-f437-4a40-8bfd-23caab763696 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:46.321267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b2421578-f437-4a40-8bfd-23caab763696 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:46.325424 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b2421578-f437-4a40-8bfd-23caab763696 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:46.398473 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23f39828-3c70-49bd-a49e-86c5c1540c79 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:46.447681 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23f39828-3c70-49bd-a49e-86c5c1540c79 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.414532 Jul 25 16:27:46.452351 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 136/311] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:46 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:46.754338 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b2421578-f437-4a40-8bfd-23caab763696 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:46.764820 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b2421578-f437-4a40-8bfd-23caab763696 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.476363 Jul 25 16:27:46.783924 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 176/312] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:46 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:47.498962 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-00c0fe41-8322-4eff-ae23-d03ffb245f15 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:47.500304 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-00c0fe41-8322-4eff-ae23-d03ffb245f15 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:47.512606 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00c0fe41-8322-4eff-ae23-d03ffb245f15 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:47.513546 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00c0fe41-8322-4eff-ae23-d03ffb245f15 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:47.515028 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00c0fe41-8322-4eff-ae23-d03ffb245f15 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:47.515807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-00c0fe41-8322-4eff-ae23-d03ffb245f15 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:47.703118 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-00c0fe41-8322-4eff-ae23-d03ffb245f15 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:47.711942 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-00c0fe41-8322-4eff-ae23-d03ffb245f15 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.222916 Jul 25 16:27:47.712644 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 137/313] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:47 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:47.795287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7dd4db9e-5f05-4d3e-a01b-e88362f7b5a3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:47.796546 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7dd4db9e-5f05-4d3e-a01b-e88362f7b5a3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:47.806921 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7dd4db9e-5f05-4d3e-a01b-e88362f7b5a3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:47.807572 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7dd4db9e-5f05-4d3e-a01b-e88362f7b5a3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:47.808765 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7dd4db9e-5f05-4d3e-a01b-e88362f7b5a3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:47.809781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7dd4db9e-5f05-4d3e-a01b-e88362f7b5a3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:48.137757 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7dd4db9e-5f05-4d3e-a01b-e88362f7b5a3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:48.156009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7dd4db9e-5f05-4d3e-a01b-e88362f7b5a3 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.367385 Jul 25 16:27:48.159303 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 177/314] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:47 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:48.255229 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-275888927", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:48.350827 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] validate_networks() for None {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:27:48.738517 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1a3b4b84-bdaf-4ee1-a987-b0cd15248712 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:48.740355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1a3b4b84-bdaf-4ee1-a987-b0cd15248712 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:48.752581 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a3b4b84-bdaf-4ee1-a987-b0cd15248712 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:48.754066 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a3b4b84-bdaf-4ee1-a987-b0cd15248712 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:48.755810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a3b4b84-bdaf-4ee1-a987-b0cd15248712 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:48.756826 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a3b4b84-bdaf-4ee1-a987-b0cd15248712 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:48.855251 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:27:48.856416 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:27:48.857456 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:27:48.858698 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:27:48.859333 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:27:48.873864 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:48.875251 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:48.875676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:48.876107 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:48.901132 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Getting quotas for project bf1042b61955413fad23679484f9c891. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:27:48.913048 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Getting quotas for user e3d9262041784601bcb07c805038118c and project bf1042b61955413fad23679484f9c891. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:27:48.931275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:27:48.934037 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:27:49.014517 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-208beedf-e864-4ee2-a9fa-aa6e528b1f50 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765313 Jul 25 16:27:49.021411 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 138/315] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:27:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:27:49.043655 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-daab7dd4-03a3-4a5e-b577-ddef50de4cdc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:49.044455 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-daab7dd4-03a3-4a5e-b577-ddef50de4cdc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:49.198271 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1a3b4b84-bdaf-4ee1-a987-b0cd15248712 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:49.201229 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-daab7dd4-03a3-4a5e-b577-ddef50de4cdc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:49.276287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1a3b4b84-bdaf-4ee1-a987-b0cd15248712 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.545742 Jul 25 16:27:49.276935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-daab7dd4-03a3-4a5e-b577-ddef50de4cdc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1214 microversion: 2.1 time: 0.236595 Jul 25 16:27:49.279725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 139/316] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:49 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:49.285307 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 178/317] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:48 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:49.306812 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8b2fe598-8bca-4694-8fd7-827e6ab58ec9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:49.310479 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8b2fe598-8bca-4694-8fd7-827e6ab58ec9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:49.326174 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b2fe598-8bca-4694-8fd7-827e6ab58ec9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:49.327147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b2fe598-8bca-4694-8fd7-827e6ab58ec9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:49.328668 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b2fe598-8bca-4694-8fd7-827e6ab58ec9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:49.329581 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8b2fe598-8bca-4694-8fd7-827e6ab58ec9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:49.623924 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8b2fe598-8bca-4694-8fd7-827e6ab58ec9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:49.641426 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8b2fe598-8bca-4694-8fd7-827e6ab58ec9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.358092 Jul 25 16:27:49.642328 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 140/318] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:49 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:50.080437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-69ad3d8b-ae7c-4c9e-a80f-b6240f7e047b req-70a250ca-fc76-4336-8350-81f2317c740e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550fc385-910d-4a1a-8d15-13f92691d031", "tag": "9a46516f-6426-4c10-a5d9-637e54e69b85"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:50.117187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-69ad3d8b-ae7c-4c9e-a80f-b6240f7e047b req-70a250ca-fc76-4336-8350-81f2317c740e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.119916 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-69ad3d8b-ae7c-4c9e-a80f-b6240f7e047b req-70a250ca-fc76-4336-8350-81f2317c740e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.164185 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-69ad3d8b-ae7c-4c9e-a80f-b6240f7e047b req-70a250ca-fc76-4336-8350-81f2317c740e service nova] Creating event network-changed:9a46516f-6426-4c10-a5d9-637e54e69b85 for instance 550fc385-910d-4a1a-8d15-13f92691d031 on hv-cinder-83697 Jul 25 16:27:50.186283 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-69ad3d8b-ae7c-4c9e-a80f-b6240f7e047b req-70a250ca-fc76-4336-8350-81f2317c740e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131328 Jul 25 16:27:50.189619 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 179/319] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:50.308962 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-896e80c6-e212-44f3-be29-5b8d36d61dc0 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:50.309963 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-896e80c6-e212-44f3-be29-5b8d36d61dc0 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:50.315635 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f5611eae-c2ec-4395-95d8-719bb696c609 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:50.317526 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f5611eae-c2ec-4395-95d8-719bb696c609 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:50.321052 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896e80c6-e212-44f3-be29-5b8d36d61dc0 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.322147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896e80c6-e212-44f3-be29-5b8d36d61dc0 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.323152 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896e80c6-e212-44f3-be29-5b8d36d61dc0 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.323693 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-896e80c6-e212-44f3-be29-5b8d36d61dc0 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.325922 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f5611eae-c2ec-4395-95d8-719bb696c609 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.326422 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f5611eae-c2ec-4395-95d8-719bb696c609 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.327977 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f5611eae-c2ec-4395-95d8-719bb696c609 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.328427 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f5611eae-c2ec-4395-95d8-719bb696c609 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.466760 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f5611eae-c2ec-4395-95d8-719bb696c609 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:50.487633 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f5611eae-c2ec-4395-95d8-719bb696c609 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1266 microversion: 2.1 time: 0.176821 Jul 25 16:27:50.488630 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 180/320] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:50 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:50.595999 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-896e80c6-e212-44f3-be29-5b8d36d61dc0 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:50.614389 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-896e80c6-e212-44f3-be29-5b8d36d61dc0 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.310130 Jul 25 16:27:50.615690 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 141/321] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:50 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:50.669781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-45dfb3ab-e3aa-481d-b9cb-f099d5cf71c4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:50.670400 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-45dfb3ab-e3aa-481d-b9cb-f099d5cf71c4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:50.678030 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45dfb3ab-e3aa-481d-b9cb-f099d5cf71c4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.678480 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45dfb3ab-e3aa-481d-b9cb-f099d5cf71c4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.679314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45dfb3ab-e3aa-481d-b9cb-f099d5cf71c4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:50.680128 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45dfb3ab-e3aa-481d-b9cb-f099d5cf71c4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:50.921966 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-45dfb3ab-e3aa-481d-b9cb-f099d5cf71c4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:50.934325 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-45dfb3ab-e3aa-481d-b9cb-f099d5cf71c4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.268793 Jul 25 16:27:50.934951 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 181/322] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:50 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:51.522888 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c8efdaf2-04ba-4634-9075-416b9edf9844 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:51.523913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c8efdaf2-04ba-4634-9075-416b9edf9844 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:51.531587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8efdaf2-04ba-4634-9075-416b9edf9844 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.532054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8efdaf2-04ba-4634-9075-416b9edf9844 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.532867 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8efdaf2-04ba-4634-9075-416b9edf9844 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.533368 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8efdaf2-04ba-4634-9075-416b9edf9844 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.607118 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8efdaf2-04ba-4634-9075-416b9edf9844 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:51.613444 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:51.623595 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c8efdaf2-04ba-4634-9075-416b9edf9844 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1266 microversion: 2.1 time: 0.104738 Jul 25 16:27:51.624610 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 142/323] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:51 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:51.651015 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cc7386e4-6bac-4c0e-86a3-d26b0bfbc440 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:51.652115 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cc7386e4-6bac-4c0e-86a3-d26b0bfbc440 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:51.663585 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc7386e4-6bac-4c0e-86a3-d26b0bfbc440 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.664370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc7386e4-6bac-4c0e-86a3-d26b0bfbc440 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.665791 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc7386e4-6bac-4c0e-86a3-d26b0bfbc440 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.666537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cc7386e4-6bac-4c0e-86a3-d26b0bfbc440 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.874369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cc7386e4-6bac-4c0e-86a3-d26b0bfbc440 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:51.888041 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cc7386e4-6bac-4c0e-86a3-d26b0bfbc440 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.244053 Jul 25 16:27:51.889071 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 182/324] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:51 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:51.959167 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-84653cb3-6682-4726-9376-a3b7fa4e6b9c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:51.959932 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-84653cb3-6682-4726-9376-a3b7fa4e6b9c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:51.974321 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84653cb3-6682-4726-9376-a3b7fa4e6b9c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.974872 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84653cb3-6682-4726-9376-a3b7fa4e6b9c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:51.975790 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84653cb3-6682-4726-9376-a3b7fa4e6b9c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:51.976369 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-84653cb3-6682-4726-9376-a3b7fa4e6b9c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:52.178392 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-84653cb3-6682-4726-9376-a3b7fa4e6b9c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:52.194506 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-84653cb3-6682-4726-9376-a3b7fa4e6b9c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.239969 Jul 25 16:27:52.195556 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 143/325] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:51 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:52.663105 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-24412842-048a-472c-8e3d-2d1dd5142e11 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:52.664223 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-24412842-048a-472c-8e3d-2d1dd5142e11 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:52.672844 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24412842-048a-472c-8e3d-2d1dd5142e11 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:52.673514 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24412842-048a-472c-8e3d-2d1dd5142e11 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:52.674388 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24412842-048a-472c-8e3d-2d1dd5142e11 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:52.674889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-24412842-048a-472c-8e3d-2d1dd5142e11 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:52.759631 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-24412842-048a-472c-8e3d-2d1dd5142e11 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:52.771700 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-24412842-048a-472c-8e3d-2d1dd5142e11 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1266 microversion: 2.1 time: 0.117213 Jul 25 16:27:52.772561 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 183/326] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:52 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:52.925389 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a372d968-c542-4923-bd77-73e3c30e464f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:52.926247 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a372d968-c542-4923-bd77-73e3c30e464f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:52.938745 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a372d968-c542-4923-bd77-73e3c30e464f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:52.939504 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a372d968-c542-4923-bd77-73e3c30e464f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:52.940738 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a372d968-c542-4923-bd77-73e3c30e464f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:52.941484 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a372d968-c542-4923-bd77-73e3c30e464f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.162266 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a372d968-c542-4923-bd77-73e3c30e464f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:53.172928 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a372d968-c542-4923-bd77-73e3c30e464f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.253369 Jul 25 16:27:53.173638 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 144/327] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:52 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:53.217309 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dac1ef51-ffc7-4a56-a81d-52e0efe1b7df tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:53.218080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dac1ef51-ffc7-4a56-a81d-52e0efe1b7df tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:53.225848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dac1ef51-ffc7-4a56-a81d-52e0efe1b7df tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.226706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dac1ef51-ffc7-4a56-a81d-52e0efe1b7df tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.228030 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dac1ef51-ffc7-4a56-a81d-52e0efe1b7df tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.228862 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dac1ef51-ffc7-4a56-a81d-52e0efe1b7df tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.408957 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dac1ef51-ffc7-4a56-a81d-52e0efe1b7df tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:53.419880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dac1ef51-ffc7-4a56-a81d-52e0efe1b7df tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.206622 Jul 25 16:27:53.420328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 184/328] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:53 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:53.795765 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5de6cee8-4d8f-4c4e-a7d6-079402f063bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:53.796467 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5de6cee8-4d8f-4c4e-a7d6-079402f063bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:53.806080 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5de6cee8-4d8f-4c4e-a7d6-079402f063bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.806798 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5de6cee8-4d8f-4c4e-a7d6-079402f063bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.808064 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5de6cee8-4d8f-4c4e-a7d6-079402f063bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.809368 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5de6cee8-4d8f-4c4e-a7d6-079402f063bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.892396 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-015e2216-8922-4c5d-902a-d251c010a12f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:53.893702 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-015e2216-8922-4c5d-902a-d251c010a12f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:53.907197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-015e2216-8922-4c5d-902a-d251c010a12f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.909088 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-015e2216-8922-4c5d-902a-d251c010a12f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.910964 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-015e2216-8922-4c5d-902a-d251c010a12f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:53.911990 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-015e2216-8922-4c5d-902a-d251c010a12f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:53.934725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5de6cee8-4d8f-4c4e-a7d6-079402f063bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:53.965317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5de6cee8-4d8f-4c4e-a7d6-079402f063bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1266 microversion: 2.1 time: 0.172938 Jul 25 16:27:53.966125 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 145/329] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:53 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:54.203687 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dc945132-98fc-4acf-a3c1-8e890537892a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:54.209005 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dc945132-98fc-4acf-a3c1-8e890537892a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:54.238327 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc945132-98fc-4acf-a3c1-8e890537892a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:54.246107 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc945132-98fc-4acf-a3c1-8e890537892a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:54.251808 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc945132-98fc-4acf-a3c1-8e890537892a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:54.255309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc945132-98fc-4acf-a3c1-8e890537892a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:54.356415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-015e2216-8922-4c5d-902a-d251c010a12f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lazy-loading 'services' on Instance uuid bfffb541-3a46-4a3f-ad6c-8d7a88586b23 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:27:54.608824 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-015e2216-8922-4c5d-902a-d251c010a12f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/os-volume_attachments/d7c9ba06-ad6c-4322-a101-3b8b782e735a" status: 202 len: 0 microversion: 2.1 time: 0.724515 Jul 25 16:27:54.613124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 185/330] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:27:53 2022] DELETE /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/os-volume_attachments/d7c9ba06-ad6c-4322-a101-3b8b782e735a => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:27:54.640966 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-695b6702-f912-4fbf-98e2-44b089074737 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:54.641712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-695b6702-f912-4fbf-98e2-44b089074737 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:54.668302 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-695b6702-f912-4fbf-98e2-44b089074737 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:54.668822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-695b6702-f912-4fbf-98e2-44b089074737 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:54.673939 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-695b6702-f912-4fbf-98e2-44b089074737 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:54.678382 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-695b6702-f912-4fbf-98e2-44b089074737 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:54.712891 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dc945132-98fc-4acf-a3c1-8e890537892a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:54.723958 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dc945132-98fc-4acf-a3c1-8e890537892a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.530895 Jul 25 16:27:54.728891 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 146/331] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:54 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:54.949757 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-695b6702-f912-4fbf-98e2-44b089074737 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:54.962155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-695b6702-f912-4fbf-98e2-44b089074737 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.347143 Jul 25 16:27:54.963914 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 186/332] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:54 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:54.996268 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-98ff7e69-9d38-4c5b-acf2-9b379bcc8d89 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:54.997391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-98ff7e69-9d38-4c5b-acf2-9b379bcc8d89 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:55.008566 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98ff7e69-9d38-4c5b-acf2-9b379bcc8d89 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:55.009877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98ff7e69-9d38-4c5b-acf2-9b379bcc8d89 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:55.011183 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98ff7e69-9d38-4c5b-acf2-9b379bcc8d89 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:55.012114 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-98ff7e69-9d38-4c5b-acf2-9b379bcc8d89 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:55.134911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-98ff7e69-9d38-4c5b-acf2-9b379bcc8d89 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:55.149990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-98ff7e69-9d38-4c5b-acf2-9b379bcc8d89 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1272 microversion: 2.1 time: 0.160891 Jul 25 16:27:55.151233 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 147/333] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:54 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:55.770442 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-70b42c32-1f68-4483-bc8d-a3d9705e0a4f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:55.771500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-70b42c32-1f68-4483-bc8d-a3d9705e0a4f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:55.780077 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70b42c32-1f68-4483-bc8d-a3d9705e0a4f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:55.780826 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70b42c32-1f68-4483-bc8d-a3d9705e0a4f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:55.781970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70b42c32-1f68-4483-bc8d-a3d9705e0a4f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:55.782578 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70b42c32-1f68-4483-bc8d-a3d9705e0a4f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:56.010459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-47646289-11c4-4c55-9ffe-ce49579fe61c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:56.015383 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-47646289-11c4-4c55-9ffe-ce49579fe61c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:56.020233 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:56.032972 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47646289-11c4-4c55-9ffe-ce49579fe61c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:56.034633 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47646289-11c4-4c55-9ffe-ce49579fe61c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:56.036329 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47646289-11c4-4c55-9ffe-ce49579fe61c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:56.037440 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47646289-11c4-4c55-9ffe-ce49579fe61c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:56.068796 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-70b42c32-1f68-4483-bc8d-a3d9705e0a4f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:56.076869 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-70b42c32-1f68-4483-bc8d-a3d9705e0a4f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.310405 Jul 25 16:27:56.091423 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 187/334] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:55 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:56.186351 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a08c9391-7308-4e9e-8f89-e361d5dd8bba tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:56.187200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a08c9391-7308-4e9e-8f89-e361d5dd8bba tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:56.195444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a08c9391-7308-4e9e-8f89-e361d5dd8bba tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:56.196779 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a08c9391-7308-4e9e-8f89-e361d5dd8bba tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:56.197708 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a08c9391-7308-4e9e-8f89-e361d5dd8bba tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:56.198146 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a08c9391-7308-4e9e-8f89-e361d5dd8bba tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:56.213288 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-47646289-11c4-4c55-9ffe-ce49579fe61c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:56.224560 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-47646289-11c4-4c55-9ffe-ce49579fe61c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.223674 Jul 25 16:27:56.231370 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 148/335] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:55 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:56.357581 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a08c9391-7308-4e9e-8f89-e361d5dd8bba tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:56.366316 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a08c9391-7308-4e9e-8f89-e361d5dd8bba tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.183995 Jul 25 16:27:56.367016 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 188/336] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:56 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:57.100824 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ee155a9a-34a5-46fd-84d7-12ca74213ce8 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:57.101490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ee155a9a-34a5-46fd-84d7-12ca74213ce8 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:57.109524 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee155a9a-34a5-46fd-84d7-12ca74213ce8 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.110020 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee155a9a-34a5-46fd-84d7-12ca74213ce8 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.110824 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee155a9a-34a5-46fd-84d7-12ca74213ce8 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.111254 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ee155a9a-34a5-46fd-84d7-12ca74213ce8 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.259594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-346e7a78-d1b1-47f4-ac46-0cea47396250 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:57.260498 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-346e7a78-d1b1-47f4-ac46-0cea47396250 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:57.267781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-346e7a78-d1b1-47f4-ac46-0cea47396250 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.268310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-346e7a78-d1b1-47f4-ac46-0cea47396250 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.269163 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-346e7a78-d1b1-47f4-ac46-0cea47396250 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.269686 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-346e7a78-d1b1-47f4-ac46-0cea47396250 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.315748 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ee155a9a-34a5-46fd-84d7-12ca74213ce8 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:57.328567 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ee155a9a-34a5-46fd-84d7-12ca74213ce8 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.232301 Jul 25 16:27:57.329288 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 149/337] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:57 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:57.389509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3b83cf7-f67e-4390-9ff5-c0d42325ce6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:57.392285 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3b83cf7-f67e-4390-9ff5-c0d42325ce6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:57.408370 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3b83cf7-f67e-4390-9ff5-c0d42325ce6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.412337 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3b83cf7-f67e-4390-9ff5-c0d42325ce6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.414569 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3b83cf7-f67e-4390-9ff5-c0d42325ce6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:57.416316 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3b83cf7-f67e-4390-9ff5-c0d42325ce6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:57.528292 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-346e7a78-d1b1-47f4-ac46-0cea47396250 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:57.551590 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-346e7a78-d1b1-47f4-ac46-0cea47396250 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.293128 Jul 25 16:27:57.552462 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 189/338] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:57 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:57.635768 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3b83cf7-f67e-4390-9ff5-c0d42325ce6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:57.651177 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3b83cf7-f67e-4390-9ff5-c0d42325ce6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.265463 Jul 25 16:27:57.653089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 150/339] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:57 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:27:58.365798 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2e9ff925-894e-4fdb-a14a-a3b631ea288f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:58.366640 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2e9ff925-894e-4fdb-a14a-a3b631ea288f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:58.374600 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e9ff925-894e-4fdb-a14a-a3b631ea288f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.375363 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e9ff925-894e-4fdb-a14a-a3b631ea288f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.376397 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e9ff925-894e-4fdb-a14a-a3b631ea288f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.376905 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2e9ff925-894e-4fdb-a14a-a3b631ea288f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.415579 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9adf4130-02c4-401e-9095-95d6bae7fa5e req-488720a2-ef58-4749-86b6-530bdec286de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf", "tag": "08546f13-2203-4070-8897-56c91c8e22a5"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:27:58.464952 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9adf4130-02c4-401e-9095-95d6bae7fa5e req-488720a2-ef58-4749-86b6-530bdec286de service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.466058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9adf4130-02c4-401e-9095-95d6bae7fa5e req-488720a2-ef58-4749-86b6-530bdec286de service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.484939 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-9adf4130-02c4-401e-9095-95d6bae7fa5e req-488720a2-ef58-4749-86b6-530bdec286de service nova] Creating event network-changed:08546f13-2203-4070-8897-56c91c8e22a5 for instance 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf on hv-cinder-83697 Jul 25 16:27:58.496213 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9adf4130-02c4-401e-9095-95d6bae7fa5e req-488720a2-ef58-4749-86b6-530bdec286de service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086175 Jul 25 16:27:58.500107 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 151/340] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:27:58.585634 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-531d2195-9d4b-458b-b80a-5f6a33e86362 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:58.587228 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-531d2195-9d4b-458b-b80a-5f6a33e86362 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:58.603250 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2e9ff925-894e-4fdb-a14a-a3b631ea288f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:58.604356 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-531d2195-9d4b-458b-b80a-5f6a33e86362 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.605737 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-531d2195-9d4b-458b-b80a-5f6a33e86362 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.607263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-531d2195-9d4b-458b-b80a-5f6a33e86362 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.608381 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-531d2195-9d4b-458b-b80a-5f6a33e86362 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.620818 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2e9ff925-894e-4fdb-a14a-a3b631ea288f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.260044 Jul 25 16:27:58.622610 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 190/341] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:58 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:58.685408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b1e54b58-907c-425a-8405-9bbb89ba97b7 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:58.686124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b1e54b58-907c-425a-8405-9bbb89ba97b7 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:58.696688 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1e54b58-907c-425a-8405-9bbb89ba97b7 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.698089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1e54b58-907c-425a-8405-9bbb89ba97b7 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.699746 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1e54b58-907c-425a-8405-9bbb89ba97b7 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:58.700774 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1e54b58-907c-425a-8405-9bbb89ba97b7 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:58.733828 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:58.887937 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:59.066305 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-531d2195-9d4b-458b-b80a-5f6a33e86362 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:59.080737 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b1e54b58-907c-425a-8405-9bbb89ba97b7 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:59.083019 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-531d2195-9d4b-458b-b80a-5f6a33e86362 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.506685 Jul 25 16:27:59.085068 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 152/342] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:58 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:59.107044 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b1e54b58-907c-425a-8405-9bbb89ba97b7 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.426949 Jul 25 16:27:59.107724 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 191/343] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:58 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:27:59.659564 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c65d28c8-6f61-4e5b-955e-e0eb84e43a55 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:27:59.660496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c65d28c8-6f61-4e5b-955e-e0eb84e43a55 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:27:59.662358 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=8 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:27:59.669091 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c65d28c8-6f61-4e5b-955e-e0eb84e43a55 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:59.669819 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c65d28c8-6f61-4e5b-955e-e0eb84e43a55 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:59.670653 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c65d28c8-6f61-4e5b-955e-e0eb84e43a55 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:27:59.671275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c65d28c8-6f61-4e5b-955e-e0eb84e43a55 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:27:59.835749 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c65d28c8-6f61-4e5b-955e-e0eb84e43a55 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:27:59.844407 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c65d28c8-6f61-4e5b-955e-e0eb84e43a55 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.190902 Jul 25 16:27:59.844970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 153/344] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:27:59 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:00.109049 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3d8e1840-a04b-49e4-82d1-66214ea5b45f tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:00.109829 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3d8e1840-a04b-49e4-82d1-66214ea5b45f tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:00.118346 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d8e1840-a04b-49e4-82d1-66214ea5b45f tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:00.119091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d8e1840-a04b-49e4-82d1-66214ea5b45f tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:00.119917 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d8e1840-a04b-49e4-82d1-66214ea5b45f tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:00.120394 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3d8e1840-a04b-49e4-82d1-66214ea5b45f tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:00.155505 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-666e8187-69f1-4c28-b81c-b7872ff20320 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:00.158134 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-666e8187-69f1-4c28-b81c-b7872ff20320 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:00.171663 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-666e8187-69f1-4c28-b81c-b7872ff20320 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:00.174671 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-666e8187-69f1-4c28-b81c-b7872ff20320 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:00.178661 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-666e8187-69f1-4c28-b81c-b7872ff20320 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:00.180067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-666e8187-69f1-4c28-b81c-b7872ff20320 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:00.457489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3d8e1840-a04b-49e4-82d1-66214ea5b45f tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:00.479865 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3d8e1840-a04b-49e4-82d1-66214ea5b45f tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.376073 Jul 25 16:28:00.483957 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 192/345] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:00 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:00.484197 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-666e8187-69f1-4c28-b81c-b7872ff20320 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:00.497567 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-666e8187-69f1-4c28-b81c-b7872ff20320 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.355363 Jul 25 16:28:00.498705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 154/346] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:00 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:00.867522 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b7faa5c-84f0-4b34-8667-619293ea6b8b tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:00.868068 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7b7faa5c-84f0-4b34-8667-619293ea6b8b tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:00.875099 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b7faa5c-84f0-4b34-8667-619293ea6b8b tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:00.875521 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b7faa5c-84f0-4b34-8667-619293ea6b8b tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:00.876048 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b7faa5c-84f0-4b34-8667-619293ea6b8b tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:00.876477 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7b7faa5c-84f0-4b34-8667-619293ea6b8b tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.052285 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7b7faa5c-84f0-4b34-8667-619293ea6b8b tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:01.065993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b7faa5c-84f0-4b34-8667-619293ea6b8b tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.202715 Jul 25 16:28:01.067021 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 193/347] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:00 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:01.144061 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-3a5b9c3d-38f0-4fa0-b3de-e91ca8560413 req-60e01b48-2c3f-498f-b84a-a9190f06bb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e15a0f-ed99-4348-98a3-10a6a91e7d3c", "name": "network-vif-plugged", "status": "completed", "tag": "c088b66c-9e47-45df-a77e-878bab58d1aa"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:01.157576 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3a5b9c3d-38f0-4fa0-b3de-e91ca8560413 req-60e01b48-2c3f-498f-b84a-a9190f06bb80 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:01.158551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-3a5b9c3d-38f0-4fa0-b3de-e91ca8560413 req-60e01b48-2c3f-498f-b84a-a9190f06bb80 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.172475 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-3a5b9c3d-38f0-4fa0-b3de-e91ca8560413 req-60e01b48-2c3f-498f-b84a-a9190f06bb80 service nova] Creating event network-vif-plugged:c088b66c-9e47-45df-a77e-878bab58d1aa for instance c7e15a0f-ed99-4348-98a3-10a6a91e7d3c on hv-cinder-83697 Jul 25 16:28:01.178051 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-3a5b9c3d-38f0-4fa0-b3de-e91ca8560413 req-60e01b48-2c3f-498f-b84a-a9190f06bb80 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038119 Jul 25 16:28:01.178683 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 155/348] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:01.503457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7642c8fe-5f23-4a20-aa4d-4e55c57d72c9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:01.504151 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7642c8fe-5f23-4a20-aa4d-4e55c57d72c9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:01.510987 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7642c8fe-5f23-4a20-aa4d-4e55c57d72c9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:01.511436 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7642c8fe-5f23-4a20-aa4d-4e55c57d72c9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.512209 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7642c8fe-5f23-4a20-aa4d-4e55c57d72c9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:01.512638 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7642c8fe-5f23-4a20-aa4d-4e55c57d72c9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.523823 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bcd9b044-b983-4b21-9aeb-ddfc0e2ddf2e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:01.524918 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bcd9b044-b983-4b21-9aeb-ddfc0e2ddf2e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:01.533875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd9b044-b983-4b21-9aeb-ddfc0e2ddf2e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:01.534648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd9b044-b983-4b21-9aeb-ddfc0e2ddf2e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.536308 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd9b044-b983-4b21-9aeb-ddfc0e2ddf2e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:01.537877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcd9b044-b983-4b21-9aeb-ddfc0e2ddf2e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:01.739287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7642c8fe-5f23-4a20-aa4d-4e55c57d72c9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:01.749327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7642c8fe-5f23-4a20-aa4d-4e55c57d72c9 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.249675 Jul 25 16:28:01.750098 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 194/349] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:01 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:01.754883 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcd9b044-b983-4b21-9aeb-ddfc0e2ddf2e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:01.768848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bcd9b044-b983-4b21-9aeb-ddfc0e2ddf2e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.251845 Jul 25 16:28:01.769944 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 156/350] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:01 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:02.107410 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-85f46989-78e7-4e9e-8e21-67f25b812740 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:02.108028 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-85f46989-78e7-4e9e-8e21-67f25b812740 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:02.121858 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85f46989-78e7-4e9e-8e21-67f25b812740 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.123257 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85f46989-78e7-4e9e-8e21-67f25b812740 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.125480 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85f46989-78e7-4e9e-8e21-67f25b812740 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.126503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85f46989-78e7-4e9e-8e21-67f25b812740 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.419273 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-85f46989-78e7-4e9e-8e21-67f25b812740 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:02.464177 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-85f46989-78e7-4e9e-8e21-67f25b812740 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.366732 Jul 25 16:28:02.466883 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 195/351] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:02 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:02.675051 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9095f5e9-96fc-48d6-8bdc-6e67c1debe65 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:02.694364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9095f5e9-96fc-48d6-8bdc-6e67c1debe65 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.695227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9095f5e9-96fc-48d6-8bdc-6e67c1debe65 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.743502 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9095f5e9-96fc-48d6-8bdc-6e67c1debe65 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Going to try to stop instance {{(pid=117920) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 16:28:02.786261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-027ada84-5d6c-45a2-969d-2753689b88c7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:02.787386 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-027ada84-5d6c-45a2-969d-2753689b88c7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:02.799042 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-027ada84-5d6c-45a2-969d-2753689b88c7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.799831 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-027ada84-5d6c-45a2-969d-2753689b88c7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.801500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-027ada84-5d6c-45a2-969d-2753689b88c7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.802268 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-027ada84-5d6c-45a2-969d-2753689b88c7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.833103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9095f5e9-96fc-48d6-8bdc-6e67c1debe65 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/action" status: 202 len: 0 microversion: 2.1 time: 0.181036 Jul 25 16:28:02.834622 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 157/352] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:28:02 2022] POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:28:02.844570 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-33ae0ac3-7af4-4d9f-abcd-2a29031b98bc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:02.845954 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-33ae0ac3-7af4-4d9f-abcd-2a29031b98bc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:02.860330 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33ae0ac3-7af4-4d9f-abcd-2a29031b98bc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.861286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33ae0ac3-7af4-4d9f-abcd-2a29031b98bc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:02.862889 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33ae0ac3-7af4-4d9f-abcd-2a29031b98bc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:02.865845 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33ae0ac3-7af4-4d9f-abcd-2a29031b98bc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:03.020331 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-027ada84-5d6c-45a2-969d-2753689b88c7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:03.031931 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-027ada84-5d6c-45a2-969d-2753689b88c7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.253015 Jul 25 16:28:03.032524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 196/353] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:02 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:03.061390 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-709378d7-9d43-45e3-9a65-47726effb81e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:03.062319 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-709378d7-9d43-45e3-9a65-47726effb81e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:03.075134 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-709378d7-9d43-45e3-9a65-47726effb81e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:03.075917 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-709378d7-9d43-45e3-9a65-47726effb81e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:03.079846 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33ae0ac3-7af4-4d9f-abcd-2a29031b98bc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:03.082865 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-709378d7-9d43-45e3-9a65-47726effb81e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:03.083962 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-709378d7-9d43-45e3-9a65-47726effb81e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:03.092846 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-33ae0ac3-7af4-4d9f-abcd-2a29031b98bc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.256482 Jul 25 16:28:03.106214 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 158/354] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:02 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:03.311170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-709378d7-9d43-45e3-9a65-47726effb81e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:03.320242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-709378d7-9d43-45e3-9a65-47726effb81e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.270083 Jul 25 16:28:03.321089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 197/355] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:03 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:03.516674 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-290e5876-ba62-4150-9168-0147cc36d31f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:03.517317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-290e5876-ba62-4150-9168-0147cc36d31f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:03.525237 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290e5876-ba62-4150-9168-0147cc36d31f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:03.525514 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290e5876-ba62-4150-9168-0147cc36d31f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:03.526489 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290e5876-ba62-4150-9168-0147cc36d31f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:03.526918 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-290e5876-ba62-4150-9168-0147cc36d31f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:03.683411 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-290e5876-ba62-4150-9168-0147cc36d31f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:03.687087 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:03.692333 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-290e5876-ba62-4150-9168-0147cc36d31f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.193371 Jul 25 16:28:03.692918 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 159/356] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:03 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:04.040001 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-24fa0ab2-2de0-41a0-8f46-1c5aca1a4633 req-fe36f2e8-e97d-4513-bedd-e96853acec45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550fc385-910d-4a1a-8d15-13f92691d031", "name": "network-vif-plugged", "status": "completed", "tag": "9a46516f-6426-4c10-a5d9-637e54e69b85"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:04.054160 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-24fa0ab2-2de0-41a0-8f46-1c5aca1a4633 req-fe36f2e8-e97d-4513-bedd-e96853acec45 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.054998 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-24fa0ab2-2de0-41a0-8f46-1c5aca1a4633 req-fe36f2e8-e97d-4513-bedd-e96853acec45 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.061461 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8b17346-9035-4325-84be-fa17e4476c1a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:04.062845 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8b17346-9035-4325-84be-fa17e4476c1a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:04.072348 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b17346-9035-4325-84be-fa17e4476c1a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.072791 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b17346-9035-4325-84be-fa17e4476c1a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.073615 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b17346-9035-4325-84be-fa17e4476c1a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.074048 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8b17346-9035-4325-84be-fa17e4476c1a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.078739 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-24fa0ab2-2de0-41a0-8f46-1c5aca1a4633 req-fe36f2e8-e97d-4513-bedd-e96853acec45 service nova] Creating event network-vif-plugged:9a46516f-6426-4c10-a5d9-637e54e69b85 for instance 550fc385-910d-4a1a-8d15-13f92691d031 on hv-cinder-83697 Jul 25 16:28:04.087761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-24fa0ab2-2de0-41a0-8f46-1c5aca1a4633 req-fe36f2e8-e97d-4513-bedd-e96853acec45 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052403 Jul 25 16:28:04.088687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 198/357] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:04.118782 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3690f06c-541f-4ac1-8143-5bfbd3a15e9f tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:04.119588 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3690f06c-541f-4ac1-8143-5bfbd3a15e9f tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:04.155470 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3690f06c-541f-4ac1-8143-5bfbd3a15e9f tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.157783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3690f06c-541f-4ac1-8143-5bfbd3a15e9f tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.160717 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3690f06c-541f-4ac1-8143-5bfbd3a15e9f tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.162016 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3690f06c-541f-4ac1-8143-5bfbd3a15e9f tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.363447 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8b17346-9035-4325-84be-fa17e4476c1a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:04.375431 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8b17346-9035-4325-84be-fa17e4476c1a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1318 microversion: 2.1 time: 0.320655 Jul 25 16:28:04.376531 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 160/358] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:04 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:04.389204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a33575f5-f396-48e7-9b2e-38d9f317d989 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:04.391360 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a33575f5-f396-48e7-9b2e-38d9f317d989 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:04.402794 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a33575f5-f396-48e7-9b2e-38d9f317d989 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.403336 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a33575f5-f396-48e7-9b2e-38d9f317d989 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.404194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a33575f5-f396-48e7-9b2e-38d9f317d989 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.404657 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a33575f5-f396-48e7-9b2e-38d9f317d989 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.445574 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3690f06c-541f-4ac1-8143-5bfbd3a15e9f tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:04.461580 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3690f06c-541f-4ac1-8143-5bfbd3a15e9f tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.341435 Jul 25 16:28:04.461580 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 199/359] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:04 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:04.616859 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a33575f5-f396-48e7-9b2e-38d9f317d989 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:04.626684 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a33575f5-f396-48e7-9b2e-38d9f317d989 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.248071 Jul 25 16:28:04.637615 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 161/360] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:04 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:04.720651 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-aac05ed9-8a9a-406e-8159-de6ba3f6ffd9 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:04.723444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-aac05ed9-8a9a-406e-8159-de6ba3f6ffd9 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:04.743113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aac05ed9-8a9a-406e-8159-de6ba3f6ffd9 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.745436 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aac05ed9-8a9a-406e-8159-de6ba3f6ffd9 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:04.747987 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aac05ed9-8a9a-406e-8159-de6ba3f6ffd9 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:04.749499 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-aac05ed9-8a9a-406e-8159-de6ba3f6ffd9 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.016753 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aac05ed9-8a9a-406e-8159-de6ba3f6ffd9 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:05.032860 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-aac05ed9-8a9a-406e-8159-de6ba3f6ffd9 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.320538 Jul 25 16:28:05.052901 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 200/361] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:04 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:05.410246 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-596b2ea0-5e4f-467d-ac30-3ed8838fb306 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:05.411258 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-596b2ea0-5e4f-467d-ac30-3ed8838fb306 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:05.423121 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-596b2ea0-5e4f-467d-ac30-3ed8838fb306 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.423926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-596b2ea0-5e4f-467d-ac30-3ed8838fb306 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.425319 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-596b2ea0-5e4f-467d-ac30-3ed8838fb306 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.426096 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-596b2ea0-5e4f-467d-ac30-3ed8838fb306 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.487773 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b913e0a1-8035-44d4-ab08-e406a24c1e8d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:05.488543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b913e0a1-8035-44d4-ab08-e406a24c1e8d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:05.491449 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=68 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:05.499459 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b913e0a1-8035-44d4-ab08-e406a24c1e8d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.500058 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b913e0a1-8035-44d4-ab08-e406a24c1e8d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.501100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b913e0a1-8035-44d4-ab08-e406a24c1e8d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.501713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b913e0a1-8035-44d4-ab08-e406a24c1e8d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.642694 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-596b2ea0-5e4f-467d-ac30-3ed8838fb306 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:05.656629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-596b2ea0-5e4f-467d-ac30-3ed8838fb306 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1506 microversion: 2.1 time: 0.251156 Jul 25 16:28:05.657867 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 162/362] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:05 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:05.665960 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2e0c5e6-6fa4-4476-abf5-a07c0693a63c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:05.666858 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2e0c5e6-6fa4-4476-abf5-a07c0693a63c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:05.678693 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e0c5e6-6fa4-4476-abf5-a07c0693a63c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.679492 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e0c5e6-6fa4-4476-abf5-a07c0693a63c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.680992 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e0c5e6-6fa4-4476-abf5-a07c0693a63c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:05.681819 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e0c5e6-6fa4-4476-abf5-a07c0693a63c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:05.714898 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b913e0a1-8035-44d4-ab08-e406a24c1e8d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:05.725280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b913e0a1-8035-44d4-ab08-e406a24c1e8d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.243780 Jul 25 16:28:05.726313 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 201/363] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:05 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:05.912552 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2e0c5e6-6fa4-4476-abf5-a07c0693a63c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:05.921909 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2e0c5e6-6fa4-4476-abf5-a07c0693a63c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.262126 Jul 25 16:28:05.932504 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 163/364] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:05 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:06.075201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-60a9f221-d2c7-4c40-bb32-97eb160ec9dc tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:06.077509 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-60a9f221-d2c7-4c40-bb32-97eb160ec9dc tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:06.091091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60a9f221-d2c7-4c40-bb32-97eb160ec9dc tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:06.092297 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60a9f221-d2c7-4c40-bb32-97eb160ec9dc tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:06.093992 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60a9f221-d2c7-4c40-bb32-97eb160ec9dc tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:06.094868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-60a9f221-d2c7-4c40-bb32-97eb160ec9dc tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:06.416891 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-60a9f221-d2c7-4c40-bb32-97eb160ec9dc tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:06.434776 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-60a9f221-d2c7-4c40-bb32-97eb160ec9dc tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1358 microversion: 2.1 time: 0.367605 Jul 25 16:28:06.441004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 202/365] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:06 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:06.751462 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7f8b869b-c5e6-44d7-ba19-5cf2a7ff0f35 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:06.753926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7f8b869b-c5e6-44d7-ba19-5cf2a7ff0f35 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:06.765832 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f8b869b-c5e6-44d7-ba19-5cf2a7ff0f35 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:06.767098 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f8b869b-c5e6-44d7-ba19-5cf2a7ff0f35 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:06.769542 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f8b869b-c5e6-44d7-ba19-5cf2a7ff0f35 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:06.770551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7f8b869b-c5e6-44d7-ba19-5cf2a7ff0f35 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:06.958604 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6f004db6-f34a-4849-8dfb-0ed3a98f4728 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:06.959226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6f004db6-f34a-4849-8dfb-0ed3a98f4728 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:06.966815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f004db6-f34a-4849-8dfb-0ed3a98f4728 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:06.967260 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f004db6-f34a-4849-8dfb-0ed3a98f4728 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:06.968318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f004db6-f34a-4849-8dfb-0ed3a98f4728 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:06.968754 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6f004db6-f34a-4849-8dfb-0ed3a98f4728 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:06.980368 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7f8b869b-c5e6-44d7-ba19-5cf2a7ff0f35 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:06.991477 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7f8b869b-c5e6-44d7-ba19-5cf2a7ff0f35 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.245263 Jul 25 16:28:06.992627 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 164/366] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:06 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:07.239326 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6f004db6-f34a-4849-8dfb-0ed3a98f4728 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:07.248072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6f004db6-f34a-4849-8dfb-0ed3a98f4728 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.293500 Jul 25 16:28:07.248646 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 203/367] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:06 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:07.473133 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e1d92496-f846-44e9-84f3-8fb4c5976fcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:07.474327 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e1d92496-f846-44e9-84f3-8fb4c5976fcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:07.486730 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1d92496-f846-44e9-84f3-8fb4c5976fcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:07.487420 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1d92496-f846-44e9-84f3-8fb4c5976fcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:07.489568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1d92496-f846-44e9-84f3-8fb4c5976fcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:07.490396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e1d92496-f846-44e9-84f3-8fb4c5976fcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:07.721887 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e1d92496-f846-44e9-84f3-8fb4c5976fcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:07.737983 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e1d92496-f846-44e9-84f3-8fb4c5976fcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1548 microversion: 2.1 time: 0.272555 Jul 25 16:28:07.753407 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 165/368] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:07 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1548 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:07.767115 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7e19715b-5ebc-4937-bc0a-e44bc0bccc07 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:07.768486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7e19715b-5ebc-4937-bc0a-e44bc0bccc07 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:07.777668 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e19715b-5ebc-4937-bc0a-e44bc0bccc07 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:07.778368 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e19715b-5ebc-4937-bc0a-e44bc0bccc07 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:07.779329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e19715b-5ebc-4937-bc0a-e44bc0bccc07 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:07.779860 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e19715b-5ebc-4937-bc0a-e44bc0bccc07 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.015125 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f286705-d26c-4fd6-ab3e-dac12439bb6d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:08.015875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f286705-d26c-4fd6-ab3e-dac12439bb6d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:08.025083 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f286705-d26c-4fd6-ab3e-dac12439bb6d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.025703 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f286705-d26c-4fd6-ab3e-dac12439bb6d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.026528 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f286705-d26c-4fd6-ab3e-dac12439bb6d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.026961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f286705-d26c-4fd6-ab3e-dac12439bb6d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.047729 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7e19715b-5ebc-4937-bc0a-e44bc0bccc07 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:08.057969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7e19715b-5ebc-4937-bc0a-e44bc0bccc07 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1548 microversion: 2.1 time: 0.296507 Jul 25 16:28:08.058828 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 204/369] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:07 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1548 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:08.107079 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d6844a3e-abe5-46aa-89a0-c834a97f10b5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:08.126619 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d6844a3e-abe5-46aa-89a0-c834a97f10b5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:08.130279 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d6844a3e-abe5-46aa-89a0-c834a97f10b5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Searching by: {'deleted': False, 'project_id': '966cf8bbbc4540a596f615498331465a'} {{(pid=117919) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 16:28:08.153945 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6844a3e-abe5-46aa-89a0-c834a97f10b5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.155020 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6844a3e-abe5-46aa-89a0-c834a97f10b5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.157121 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6844a3e-abe5-46aa-89a0-c834a97f10b5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.158186 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d6844a3e-abe5-46aa-89a0-c834a97f10b5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.275344 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6f286705-d26c-4fd6-ab3e-dac12439bb6d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:08.298116 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f286705-d26c-4fd6-ab3e-dac12439bb6d tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.286925 Jul 25 16:28:08.300076 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 166/370] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:08 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:08.321860 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-6caac6c6-086a-426f-8b0a-902218f21afd req-d43acad7-b289-463b-a849-2459a0141812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf", "name": "network-vif-plugged", "status": "completed", "tag": "08546f13-2203-4070-8897-56c91c8e22a5"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:08.351852 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-6caac6c6-086a-426f-8b0a-902218f21afd req-d43acad7-b289-463b-a849-2459a0141812 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.352292 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-6caac6c6-086a-426f-8b0a-902218f21afd req-d43acad7-b289-463b-a849-2459a0141812 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.379413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.multi_cell_list [None req-d6844a3e-abe5-46aa-89a0-c834a97f10b5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117919) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 16:28:08.392071 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-6caac6c6-086a-426f-8b0a-902218f21afd req-d43acad7-b289-463b-a849-2459a0141812 service nova] Creating event network-vif-plugged:08546f13-2203-4070-8897-56c91c8e22a5 for instance 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf on hv-cinder-83697 Jul 25 16:28:08.409129 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-6caac6c6-086a-426f-8b0a-902218f21afd req-d43acad7-b289-463b-a849-2459a0141812 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105242 Jul 25 16:28:08.412476 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 167/371] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:08.432654 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6bd7cde1-1eff-4118-bd86-dfd7e3181077 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:08.435055 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6bd7cde1-1eff-4118-bd86-dfd7e3181077 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:08.453051 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bd7cde1-1eff-4118-bd86-dfd7e3181077 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.454814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bd7cde1-1eff-4118-bd86-dfd7e3181077 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.457045 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bd7cde1-1eff-4118-bd86-dfd7e3181077 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.458518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6bd7cde1-1eff-4118-bd86-dfd7e3181077 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.616947 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d6844a3e-abe5-46aa-89a0-c834a97f10b5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.519078 Jul 25 16:28:08.618514 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 205/372] 10.222.0.66 () {58 vars in 1125 bytes} [Mon Jul 25 16:28:08 2022] GET /compute/v2.1/servers => generated 342 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:08.655840 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6d7b320e-7f57-4bbd-8ca5-be866738df1e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:08.657435 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6d7b320e-7f57-4bbd-8ca5-be866738df1e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:08.672174 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d7b320e-7f57-4bbd-8ca5-be866738df1e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.672634 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d7b320e-7f57-4bbd-8ca5-be866738df1e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:08.675137 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d7b320e-7f57-4bbd-8ca5-be866738df1e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:08.675752 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d7b320e-7f57-4bbd-8ca5-be866738df1e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:09.210598 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6bd7cde1-1eff-4118-bd86-dfd7e3181077 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:09.230159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6bd7cde1-1eff-4118-bd86-dfd7e3181077 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.813298 Jul 25 16:28:09.231930 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 168/373] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:08 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:09.264142 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6d7b320e-7f57-4bbd-8ca5-be866738df1e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:09.286409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6d7b320e-7f57-4bbd-8ca5-be866738df1e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1548 microversion: 2.1 time: 0.645422 Jul 25 16:28:09.288460 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 206/374] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:08 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1548 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:09.342982 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d92c5c01-f5ff-4a6e-ab59-66b5e13ace5e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:09.344867 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d92c5c01-f5ff-4a6e-ab59-66b5e13ace5e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:09.361279 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d92c5c01-f5ff-4a6e-ab59-66b5e13ace5e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:09.362049 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d92c5c01-f5ff-4a6e-ab59-66b5e13ace5e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:09.363414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d92c5c01-f5ff-4a6e-ab59-66b5e13ace5e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:09.364350 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d92c5c01-f5ff-4a6e-ab59-66b5e13ace5e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:09.674474 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d92c5c01-f5ff-4a6e-ab59-66b5e13ace5e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:09.688334 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d92c5c01-f5ff-4a6e-ab59-66b5e13ace5e tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.366545 Jul 25 16:28:09.688938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 169/375] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:09 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:10.268563 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2a15c91b-bbea-4072-ab7d-7b93d2b19639 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:10.269195 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2a15c91b-bbea-4072-ab7d-7b93d2b19639 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:10.293047 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a15c91b-bbea-4072-ab7d-7b93d2b19639 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:10.293534 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a15c91b-bbea-4072-ab7d-7b93d2b19639 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:10.300055 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a15c91b-bbea-4072-ab7d-7b93d2b19639 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:10.301135 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2a15c91b-bbea-4072-ab7d-7b93d2b19639 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:10.577849 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2a15c91b-bbea-4072-ab7d-7b93d2b19639 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:10.587998 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2a15c91b-bbea-4072-ab7d-7b93d2b19639 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.325220 Jul 25 16:28:10.589100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 207/376] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:10 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:10.732953 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d97a911d-8b74-4a9a-8057-cb1c29b3680c tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:10.735304 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d97a911d-8b74-4a9a-8057-cb1c29b3680c tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:10.752884 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d97a911d-8b74-4a9a-8057-cb1c29b3680c tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:10.753677 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d97a911d-8b74-4a9a-8057-cb1c29b3680c tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:10.754997 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d97a911d-8b74-4a9a-8057-cb1c29b3680c tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:10.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d97a911d-8b74-4a9a-8057-cb1c29b3680c tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:11.057700 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d97a911d-8b74-4a9a-8057-cb1c29b3680c tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:11.068141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d97a911d-8b74-4a9a-8057-cb1c29b3680c tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1314 microversion: 2.1 time: 0.342594 Jul 25 16:28:11.069159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 170/377] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:10 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:11.348325 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b2f70c11-a3dd-4c3b-9f52-f23295519242 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f33c27b3-bc39-4d6b-ac61-3814f486b7d7"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:11.351294 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b2f70c11-a3dd-4c3b-9f52-f23295519242 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:11.366321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b2f70c11-a3dd-4c3b-9f52-f23295519242 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:11.367517 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b2f70c11-a3dd-4c3b-9f52-f23295519242 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:11.369188 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b2f70c11-a3dd-4c3b-9f52-f23295519242 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:11.369985 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b2f70c11-a3dd-4c3b-9f52-f23295519242 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:11.377513 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:11.617667 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5155f47c-6687-48ab-a960-87caeeca3b8a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:11.619096 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5155f47c-6687-48ab-a960-87caeeca3b8a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:11.631135 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5155f47c-6687-48ab-a960-87caeeca3b8a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:11.631883 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5155f47c-6687-48ab-a960-87caeeca3b8a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:11.633297 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5155f47c-6687-48ab-a960-87caeeca3b8a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:11.634451 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5155f47c-6687-48ab-a960-87caeeca3b8a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:11.838655 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b2f70c11-a3dd-4c3b-9f52-f23295519242 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "POST /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495277 Jul 25 16:28:11.840315 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 208/378] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:28:11 2022] POST /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:11.913648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5155f47c-6687-48ab-a960-87caeeca3b8a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:11.938027 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5155f47c-6687-48ab-a960-87caeeca3b8a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.327826 Jul 25 16:28:11.939157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 171/379] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:11 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:12.111872 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d03ec46d-bf33-4a79-a76a-2da00b15b683 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:12.114589 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d03ec46d-bf33-4a79-a76a-2da00b15b683 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:12.126335 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d03ec46d-bf33-4a79-a76a-2da00b15b683 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.127800 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d03ec46d-bf33-4a79-a76a-2da00b15b683 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:12.129008 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d03ec46d-bf33-4a79-a76a-2da00b15b683 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.129889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d03ec46d-bf33-4a79-a76a-2da00b15b683 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:12.350085 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d03ec46d-bf33-4a79-a76a-2da00b15b683 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:12.361469 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d03ec46d-bf33-4a79-a76a-2da00b15b683 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1463 microversion: 2.1 time: 0.257767 Jul 25 16:28:12.375315 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 209/380] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:12 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1463 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:12.449067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cd248354-c221-4f96-a6b2-a8a31f2920bf tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:12.449896 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cd248354-c221-4f96-a6b2-a8a31f2920bf tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:12.468653 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd248354-c221-4f96-a6b2-a8a31f2920bf tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.469397 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd248354-c221-4f96-a6b2-a8a31f2920bf tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:12.470566 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd248354-c221-4f96-a6b2-a8a31f2920bf tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.471001 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cd248354-c221-4f96-a6b2-a8a31f2920bf tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:12.505850 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cd248354-c221-4f96-a6b2-a8a31f2920bf tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:28:12.604270 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cd248354-c221-4f96-a6b2-a8a31f2920bf tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "DELETE /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 204 len: 0 microversion: 2.1 time: 0.160214 Jul 25 16:28:12.605219 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 172/381] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:28:12 2022] DELETE /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:28:12.614356 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cf72e835-4de0-4e3f-b20c-1e6de0d38fa4 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:12.614970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cf72e835-4de0-4e3f-b20c-1e6de0d38fa4 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:12.622662 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf72e835-4de0-4e3f-b20c-1e6de0d38fa4 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.623129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf72e835-4de0-4e3f-b20c-1e6de0d38fa4 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:12.623993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf72e835-4de0-4e3f-b20c-1e6de0d38fa4 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.624422 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cf72e835-4de0-4e3f-b20c-1e6de0d38fa4 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:12.785407 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cf72e835-4de0-4e3f-b20c-1e6de0d38fa4 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:12.795475 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cf72e835-4de0-4e3f-b20c-1e6de0d38fa4 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1469 microversion: 2.1 time: 0.185236 Jul 25 16:28:12.796308 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 210/382] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:12 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:12.982696 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-307366f8-231d-43e2-bac5-51b9a02105be tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:12.983606 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-307366f8-231d-43e2-bac5-51b9a02105be tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:12.992224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-307366f8-231d-43e2-bac5-51b9a02105be tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.992942 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-307366f8-231d-43e2-bac5-51b9a02105be tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:12.994312 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-307366f8-231d-43e2-bac5-51b9a02105be tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:12.994958 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-307366f8-231d-43e2-bac5-51b9a02105be tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:13.173306 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-307366f8-231d-43e2-bac5-51b9a02105be tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:13.182058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-307366f8-231d-43e2-bac5-51b9a02105be tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.206145 Jul 25 16:28:13.182725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 173/383] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:12 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:13.819187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b110e2d0-30cf-420e-864c-344337e33d52 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:13.820167 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b110e2d0-30cf-420e-864c-344337e33d52 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:13.833762 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b110e2d0-30cf-420e-864c-344337e33d52 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:13.834519 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b110e2d0-30cf-420e-864c-344337e33d52 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:13.835810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b110e2d0-30cf-420e-864c-344337e33d52 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:13.836526 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b110e2d0-30cf-420e-864c-344337e33d52 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:14.016206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b110e2d0-30cf-420e-864c-344337e33d52 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:14.025536 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b110e2d0-30cf-420e-864c-344337e33d52 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1469 microversion: 2.1 time: 0.211410 Jul 25 16:28:14.026170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 211/384] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:13 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:14.207845 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f77ed222-83fb-498c-91db-880e7be9208c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:14.208657 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f77ed222-83fb-498c-91db-880e7be9208c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:14.220468 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77ed222-83fb-498c-91db-880e7be9208c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:14.221460 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77ed222-83fb-498c-91db-880e7be9208c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:14.222395 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77ed222-83fb-498c-91db-880e7be9208c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:14.222993 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f77ed222-83fb-498c-91db-880e7be9208c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:14.396723 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f77ed222-83fb-498c-91db-880e7be9208c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:14.409985 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f77ed222-83fb-498c-91db-880e7be9208c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.207182 Jul 25 16:28:14.411046 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 174/385] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:14 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:15.050755 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-38c50396-23ec-43fc-a996-106acf021465 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:15.052430 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-38c50396-23ec-43fc-a996-106acf021465 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:15.060326 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38c50396-23ec-43fc-a996-106acf021465 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:15.060818 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38c50396-23ec-43fc-a996-106acf021465 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:15.061694 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38c50396-23ec-43fc-a996-106acf021465 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:15.062172 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38c50396-23ec-43fc-a996-106acf021465 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:15.269763 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-38c50396-23ec-43fc-a996-106acf021465 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:15.280144 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-38c50396-23ec-43fc-a996-106acf021465 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1469 microversion: 2.1 time: 0.233891 Jul 25 16:28:15.281462 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 212/386] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:15 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1469 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:15.444254 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-05ea7b64-2266-449e-bbb1-6e3bcc7cceb0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:15.448314 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-05ea7b64-2266-449e-bbb1-6e3bcc7cceb0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:15.463163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05ea7b64-2266-449e-bbb1-6e3bcc7cceb0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:15.463963 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05ea7b64-2266-449e-bbb1-6e3bcc7cceb0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:15.465501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05ea7b64-2266-449e-bbb1-6e3bcc7cceb0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:15.466227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05ea7b64-2266-449e-bbb1-6e3bcc7cceb0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:15.501642 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:15.677891 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-05ea7b64-2266-449e-bbb1-6e3bcc7cceb0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:15.692319 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-05ea7b64-2266-449e-bbb1-6e3bcc7cceb0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.258301 Jul 25 16:28:15.693365 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 175/387] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:15 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:16.316217 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-34caf276-e4d6-4078-98f7-bb8373ebbf6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:16.317071 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-34caf276-e4d6-4078-98f7-bb8373ebbf6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:16.324579 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34caf276-e4d6-4078-98f7-bb8373ebbf6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:16.325025 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34caf276-e4d6-4078-98f7-bb8373ebbf6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:16.325892 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34caf276-e4d6-4078-98f7-bb8373ebbf6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:16.326529 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34caf276-e4d6-4078-98f7-bb8373ebbf6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:16.547425 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-34caf276-e4d6-4078-98f7-bb8373ebbf6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:16.557522 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-34caf276-e4d6-4078-98f7-bb8373ebbf6b tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1469 microversion: 2.1 time: 0.245863 Jul 25 16:28:16.558170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 213/388] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:16 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:16.725414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f0f93dd7-8fdf-4fdb-9da1-467f7e284814 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:16.726077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f0f93dd7-8fdf-4fdb-9da1-467f7e284814 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:16.734138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f93dd7-8fdf-4fdb-9da1-467f7e284814 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:16.734439 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f93dd7-8fdf-4fdb-9da1-467f7e284814 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:16.735270 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f93dd7-8fdf-4fdb-9da1-467f7e284814 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:16.735686 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f0f93dd7-8fdf-4fdb-9da1-467f7e284814 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:16.899496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f0f93dd7-8fdf-4fdb-9da1-467f7e284814 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:16.908586 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f0f93dd7-8fdf-4fdb-9da1-467f7e284814 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1677 microversion: 2.1 time: 0.187294 Jul 25 16:28:16.909189 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 176/389] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:16 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1677 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:17.584391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-05e66ea7-d03f-4c87-8004-67be6b718a36 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:17.584391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-05e66ea7-d03f-4c87-8004-67be6b718a36 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:17.596627 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-05e66ea7-d03f-4c87-8004-67be6b718a36 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:17.597399 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-05e66ea7-d03f-4c87-8004-67be6b718a36 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:17.598836 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-05e66ea7-d03f-4c87-8004-67be6b718a36 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:17.599638 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-05e66ea7-d03f-4c87-8004-67be6b718a36 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:17.832297 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-05e66ea7-d03f-4c87-8004-67be6b718a36 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:17.845848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-05e66ea7-d03f-4c87-8004-67be6b718a36 tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1469 microversion: 2.1 time: 0.267129 Jul 25 16:28:17.847069 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 214/390] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:17 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:17.940279 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b3fe6443-6b77-4159-88a7-c97cad9f617d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:17.945749 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b3fe6443-6b77-4159-88a7-c97cad9f617d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:17.960324 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3fe6443-6b77-4159-88a7-c97cad9f617d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:17.961772 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3fe6443-6b77-4159-88a7-c97cad9f617d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:17.964066 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3fe6443-6b77-4159-88a7-c97cad9f617d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:17.965191 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b3fe6443-6b77-4159-88a7-c97cad9f617d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.062391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-75d109d3-8b81-4dd3-98d3-d5e08df35de9 req-ce298fdd-b5fc-4ea8-97c4-27898361b96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf", "name": "network-vif-deleted", "tag": "08546f13-2203-4070-8897-56c91c8e22a5"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:18.081025 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-75d109d3-8b81-4dd3-98d3-d5e08df35de9 req-ce298fdd-b5fc-4ea8-97c4-27898361b96e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.082880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-75d109d3-8b81-4dd3-98d3-d5e08df35de9 req-ce298fdd-b5fc-4ea8-97c4-27898361b96e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.113001 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-75d109d3-8b81-4dd3-98d3-d5e08df35de9 req-ce298fdd-b5fc-4ea8-97c4-27898361b96e service nova] Creating event network-vif-deleted:08546f13-2203-4070-8897-56c91c8e22a5 for instance 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf on hv-cinder-83697 Jul 25 16:28:18.123684 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-75d109d3-8b81-4dd3-98d3-d5e08df35de9 req-ce298fdd-b5fc-4ea8-97c4-27898361b96e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066973 Jul 25 16:28:18.125533 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 215/391] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:18.273820 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b3fe6443-6b77-4159-88a7-c97cad9f617d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:18.286838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b3fe6443-6b77-4159-88a7-c97cad9f617d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1654 microversion: 2.1 time: 0.359180 Jul 25 16:28:18.287343 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 177/392] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:17 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1654 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:18.327154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:18.344853 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0e7c81a8-8819-483b-8d3a-24c2898a45ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:18.356035 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e7c81a8-8819-483b-8d3a-24c2898a45ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.356661 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e7c81a8-8819-483b-8d3a-24c2898a45ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.428361 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0e7c81a8-8819-483b-8d3a-24c2898a45ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Going to try to start instance {{(pid=117919) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 16:28:18.498093 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0e7c81a8-8819-483b-8d3a-24c2898a45ca tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/action" status: 202 len: 0 microversion: 2.1 time: 0.171865 Jul 25 16:28:18.499723 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 216/393] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:28:18 2022] POST /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:28:18.511696 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c5b0e0ff-1316-4352-afc0-34b4113255b1 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:18.512760 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c5b0e0ff-1316-4352-afc0-34b4113255b1 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:18.525176 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5b0e0ff-1316-4352-afc0-34b4113255b1 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.526023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5b0e0ff-1316-4352-afc0-34b4113255b1 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.527375 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5b0e0ff-1316-4352-afc0-34b4113255b1 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.528093 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c5b0e0ff-1316-4352-afc0-34b4113255b1 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.722228 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c5b0e0ff-1316-4352-afc0-34b4113255b1 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:18.732053 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c5b0e0ff-1316-4352-afc0-34b4113255b1 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1663 microversion: 2.1 time: 0.226267 Jul 25 16:28:18.733063 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 178/394] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:18 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1663 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:18.872699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:18.873439 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:18.882381 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.883364 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.884214 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.884682 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.927917 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:18.928249 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:18.928728 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lazy-loading 'fault' on Instance uuid 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:28:18.993986 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d9262041784601bcb07c805038118c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1042b61955413fad23679484f9c891', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:19.009549 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5ffa5075-71fb-45ea-ae3d-84bb6f2aabbc tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 200 len: 1304 microversion: 2.1 time: 0.141230 Jul 25 16:28:19.013505 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 217/395] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:18 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:19.775006 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-28fc36b6-e613-4b3d-a9a6-453cb1137761 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:19.778157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-28fc36b6-e613-4b3d-a9a6-453cb1137761 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:19.808876 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28fc36b6-e613-4b3d-a9a6-453cb1137761 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:19.809932 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28fc36b6-e613-4b3d-a9a6-453cb1137761 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:19.810162 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9d53b6b0-4b9b-4cb6-a327-97483239d79e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:19.810697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9d53b6b0-4b9b-4cb6-a327-97483239d79e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:19.811891 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28fc36b6-e613-4b3d-a9a6-453cb1137761 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:19.813433 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-28fc36b6-e613-4b3d-a9a6-453cb1137761 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:19.818718 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d53b6b0-4b9b-4cb6-a327-97483239d79e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:19.819245 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d53b6b0-4b9b-4cb6-a327-97483239d79e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:19.820180 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d53b6b0-4b9b-4cb6-a327-97483239d79e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:19.820812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d53b6b0-4b9b-4cb6-a327-97483239d79e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:20.055503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9d53b6b0-4b9b-4cb6-a327-97483239d79e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:20.068255 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9d53b6b0-4b9b-4cb6-a327-97483239d79e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1594 microversion: 2.1 time: 0.261769 Jul 25 16:28:20.069239 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 218/396] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:19 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1594 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:20.073077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-28fc36b6-e613-4b3d-a9a6-453cb1137761 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:20.077097 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:20.077951 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] [instance: 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:20.089041 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-28fc36b6-e613-4b3d-a9a6-453cb1137761 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1663 microversion: 2.1 time: 0.324173 Jul 25 16:28:20.090632 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 179/397] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:19 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1663 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:20.091803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:20.092464 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:20.094013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:20.095251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:20.129888 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] HTTP exception thrown: Instance 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf could not be found. Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Request method failure captured: Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf HTTP/1.1 Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sSBowt8CmbuzWzTMPZdsXXRN_J51ZrsQRffoPr8EVHKCSpNydpyk1bPWmam-SsIuc6al2K1Gn-Eze8lZeFzEr648o0tN8HYqM3XfhLMpZiIEQJmt9IYUUy3RVelBVEQxRaWf60-pYw_zSS98FsJSiWj8Edm8T5_W_i_dH5aRpwpTmg Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: bf1042b61955413fad23679484f9c891 Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-1116628464 Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:28:20.131768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bf1042b61955413fad23679484f9c891"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bf1042b61955413fad23679484f9c891"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bf1042b61955413fad23679484f9c891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bf1042b61955413fad23679484f9c891"}]}] Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-1116628464 Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: bf1042b61955413fad23679484f9c891 Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-1116628464 Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-1116628464-project Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: e3d9262041784601bcb07c805038118c Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-1116628464-project Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf could not be found. Jul 25 16:28:20.134890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf'} Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf could not be found. Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:28:20.136409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf could not be found. Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf could not be found. Jul 25 16:28:20.139154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:28:20.141723 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] Returning 404 to user: Instance 5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:28:20.141723 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9fdfdfa9-0ece-47c6-bda8-cf93e1b324bd tempest-VolumesNegativeTest-1116628464 tempest-VolumesNegativeTest-1116628464-project] 10.222.0.66 "GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf" status: 404 len: 111 microversion: 2.1 time: 0.063665 Jul 25 16:28:20.141723 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 219/398] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:20 2022] GET /compute/v2.1/servers/5cb4b462-b551-4ab2-8bdc-5c953c4dc8cf => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:28:21.142120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1cac1cbf-8744-4309-b2b8-6b7a9aaa4f9e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:21.143882 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1cac1cbf-8744-4309-b2b8-6b7a9aaa4f9e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:21.162810 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cac1cbf-8744-4309-b2b8-6b7a9aaa4f9e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:21.163757 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cac1cbf-8744-4309-b2b8-6b7a9aaa4f9e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:21.165490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cac1cbf-8744-4309-b2b8-6b7a9aaa4f9e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:21.167079 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1cac1cbf-8744-4309-b2b8-6b7a9aaa4f9e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:21.190075 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-89e6953a-ca45-45d9-9c03-4e125504e1e4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d04e95cf-f570-43ce-b518-84c752ca5335"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:21.197525 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-89e6953a-ca45-45d9-9c03-4e125504e1e4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:21.227009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89e6953a-ca45-45d9-9c03-4e125504e1e4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:21.228334 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89e6953a-ca45-45d9-9c03-4e125504e1e4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:21.230371 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89e6953a-ca45-45d9-9c03-4e125504e1e4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:21.231707 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89e6953a-ca45-45d9-9c03-4e125504e1e4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:21.775745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-89e6953a-ca45-45d9-9c03-4e125504e1e4 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.597584 Jul 25 16:28:21.777216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 220/399] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:28:21 2022] POST /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments => generated 194 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:21.818865 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1cac1cbf-8744-4309-b2b8-6b7a9aaa4f9e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:21.848028 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1cac1cbf-8744-4309-b2b8-6b7a9aaa4f9e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1663 microversion: 2.1 time: 0.719169 Jul 25 16:28:21.852694 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 180/400] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:21 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1663 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:22.891211 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-69219f15-b9ed-4f75-af9f-3a6946d5e69d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:22.892203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-69219f15-b9ed-4f75-af9f-3a6946d5e69d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:22.901072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69219f15-b9ed-4f75-af9f-3a6946d5e69d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:22.901878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69219f15-b9ed-4f75-af9f-3a6946d5e69d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:22.903091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69219f15-b9ed-4f75-af9f-3a6946d5e69d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:22.903974 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-69219f15-b9ed-4f75-af9f-3a6946d5e69d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:23.293717 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-69219f15-b9ed-4f75-af9f-3a6946d5e69d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:23.311143 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-69219f15-b9ed-4f75-af9f-3a6946d5e69d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1667 microversion: 2.1 time: 0.424960 Jul 25 16:28:23.312588 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 221/401] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:22 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1667 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:23.944639 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d50bf7c6-13b0-4173-a8a8-488aa3c2b73b req-d72e39f8-8deb-41f1-8aee-6ce7e9956a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550fc385-910d-4a1a-8d15-13f92691d031", "tag": "9a46516f-6426-4c10-a5d9-637e54e69b85"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:23.958848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d50bf7c6-13b0-4173-a8a8-488aa3c2b73b req-d72e39f8-8deb-41f1-8aee-6ce7e9956a06 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:23.959280 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d50bf7c6-13b0-4173-a8a8-488aa3c2b73b req-d72e39f8-8deb-41f1-8aee-6ce7e9956a06 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:23.975866 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d50bf7c6-13b0-4173-a8a8-488aa3c2b73b req-d72e39f8-8deb-41f1-8aee-6ce7e9956a06 service nova] Creating event network-changed:9a46516f-6426-4c10-a5d9-637e54e69b85 for instance 550fc385-910d-4a1a-8d15-13f92691d031 on hv-cinder-83697 Jul 25 16:28:23.990298 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d50bf7c6-13b0-4173-a8a8-488aa3c2b73b req-d72e39f8-8deb-41f1-8aee-6ce7e9956a06 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049658 Jul 25 16:28:23.991453 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 181/402] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:24.253534 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4deb6b6-7d0c-47ea-8c15-f68b46c15d0b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ef76f66-0049-45a6-85e6-a1fbc92423e8", "device": "/dev/sdb"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:24.261578 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4deb6b6-7d0c-47ea-8c15-f68b46c15d0b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:24.273293 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4deb6b6-7d0c-47ea-8c15-f68b46c15d0b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:24.274031 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4deb6b6-7d0c-47ea-8c15-f68b46c15d0b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:24.275328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4deb6b6-7d0c-47ea-8c15-f68b46c15d0b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:24.276067 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4deb6b6-7d0c-47ea-8c15-f68b46c15d0b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:24.280861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:24.809510 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4deb6b6-7d0c-47ea-8c15-f68b46c15d0b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "POST /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563041 Jul 25 16:28:24.811050 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 222/403] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:28:24 2022] POST /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c/os-volume_attachments => generated 194 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:25.760538 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ce516eed-d653-496f-a5fd-f83e0dbc6e5e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1303945712"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:25.761179 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ce516eed-d653-496f-a5fd-f83e0dbc6e5e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:25.768769 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce516eed-d653-496f-a5fd-f83e0dbc6e5e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:25.769214 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce516eed-d653-496f-a5fd-f83e0dbc6e5e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:25.770087 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce516eed-d653-496f-a5fd-f83e0dbc6e5e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:25.770457 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ce516eed-d653-496f-a5fd-f83e0dbc6e5e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:25.920264 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.network.security_group_api [None req-ce516eed-d653-496f-a5fd-f83e0dbc6e5e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Adding security group c9f95b60-180b-4387-9ca4-21df6638e22e to port 9a46516f-6426-4c10-a5d9-637e54e69b85 Jul 25 16:28:26.422160 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ce516eed-d653-496f-a5fd-f83e0dbc6e5e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "POST /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/action" status: 202 len: 0 microversion: 2.1 time: 0.667150 Jul 25 16:28:26.423239 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 182/404] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:28:25 2022] POST /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:28:26.437408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-150b9173-8f71-474f-abde-3d2332fb72ad tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:26.439009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-150b9173-8f71-474f-abde-3d2332fb72ad tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:26.449707 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-150b9173-8f71-474f-abde-3d2332fb72ad tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:26.450358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-150b9173-8f71-474f-abde-3d2332fb72ad tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:26.451211 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-150b9173-8f71-474f-abde-3d2332fb72ad tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:26.451848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-150b9173-8f71-474f-abde-3d2332fb72ad tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:26.470190 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-db4052bb-6ab1-430e-8a68-f52ce5fb8368 req-902a1c12-da45-4efd-903a-5419651b2e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550fc385-910d-4a1a-8d15-13f92691d031", "tag": "9a46516f-6426-4c10-a5d9-637e54e69b85"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:26.487602 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:26.496714 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-db4052bb-6ab1-430e-8a68-f52ce5fb8368 req-902a1c12-da45-4efd-903a-5419651b2e5d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:26.500209 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-db4052bb-6ab1-430e-8a68-f52ce5fb8368 req-902a1c12-da45-4efd-903a-5419651b2e5d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:26.535568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-db4052bb-6ab1-430e-8a68-f52ce5fb8368 req-902a1c12-da45-4efd-903a-5419651b2e5d service nova] Creating event network-changed:9a46516f-6426-4c10-a5d9-637e54e69b85 for instance 550fc385-910d-4a1a-8d15-13f92691d031 on hv-cinder-83697 Jul 25 16:28:26.546789 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-db4052bb-6ab1-430e-8a68-f52ce5fb8368 req-902a1c12-da45-4efd-903a-5419651b2e5d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080330 Jul 25 16:28:26.547982 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 183/405] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:28:26.675802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-150b9173-8f71-474f-abde-3d2332fb72ad tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:26.686491 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-150b9173-8f71-474f-abde-3d2332fb72ad tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1759 microversion: 2.1 time: 0.255874 Jul 25 16:28:26.688140 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 223/406] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:26 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1759 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:28.813093 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2f6c5729-1698-4be1-9de8-ed2dd9a9edb2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:28.818327 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2f6c5729-1698-4be1-9de8-ed2dd9a9edb2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:28.831191 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f6c5729-1698-4be1-9de8-ed2dd9a9edb2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:28.831955 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f6c5729-1698-4be1-9de8-ed2dd9a9edb2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:28.833374 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f6c5729-1698-4be1-9de8-ed2dd9a9edb2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:28.834152 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2f6c5729-1698-4be1-9de8-ed2dd9a9edb2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:28.883228 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-2f6c5729-1698-4be1-9de8-ed2dd9a9edb2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lazy-loading 'flavor' on Instance uuid 931c107b-f645-476f-9b81-2dab0fedf218 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:28:29.125043 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2f6c5729-1698-4be1-9de8-ed2dd9a9edb2 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/action" status: 200 len: 32 microversion: 2.1 time: 0.320237 Jul 25 16:28:29.132412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 184/407] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:28:28 2022] POST /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/action => generated 32 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:28:29.146511 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-57d19b37-3c4e-4d48-b0d1-6d46b6792c4b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:29.147555 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-57d19b37-3c4e-4d48-b0d1-6d46b6792c4b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:29.163030 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-57d19b37-3c4e-4d48-b0d1-6d46b6792c4b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:29.164044 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-57d19b37-3c4e-4d48-b0d1-6d46b6792c4b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:29.165815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-57d19b37-3c4e-4d48-b0d1-6d46b6792c4b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:29.166757 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-57d19b37-3c4e-4d48-b0d1-6d46b6792c4b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:29.436496 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-57d19b37-3c4e-4d48-b0d1-6d46b6792c4b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:29.452376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-57d19b37-3c4e-4d48-b0d1-6d46b6792c4b tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.317600 Jul 25 16:28:29.453479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 224/408] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:29 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:30.495248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b815751b-8a3a-4ddf-9ee6-32ea29c8443a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:30.496558 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b815751b-8a3a-4ddf-9ee6-32ea29c8443a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:30.510554 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b815751b-8a3a-4ddf-9ee6-32ea29c8443a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:30.511301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b815751b-8a3a-4ddf-9ee6-32ea29c8443a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:30.512947 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b815751b-8a3a-4ddf-9ee6-32ea29c8443a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:30.513729 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b815751b-8a3a-4ddf-9ee6-32ea29c8443a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:30.847964 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b815751b-8a3a-4ddf-9ee6-32ea29c8443a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:30.860582 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b815751b-8a3a-4ddf-9ee6-32ea29c8443a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.375535 Jul 25 16:28:30.866907 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 185/409] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:30 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:31.890350 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6870b588-d9eb-49df-b17e-200c412e09f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:31.891483 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6870b588-d9eb-49df-b17e-200c412e09f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:31.904603 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6870b588-d9eb-49df-b17e-200c412e09f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:31.905378 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6870b588-d9eb-49df-b17e-200c412e09f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:31.907032 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6870b588-d9eb-49df-b17e-200c412e09f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:31.908214 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6870b588-d9eb-49df-b17e-200c412e09f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:32.179839 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6870b588-d9eb-49df-b17e-200c412e09f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:32.199256 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6870b588-d9eb-49df-b17e-200c412e09f7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.317098 Jul 25 16:28:32.200806 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 225/410] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:31 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:33.241181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f910040c-aa61-4362-ae93-4b5d537eeb1e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:33.242728 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f910040c-aa61-4362-ae93-4b5d537eeb1e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:33.252688 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f910040c-aa61-4362-ae93-4b5d537eeb1e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:33.253501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f910040c-aa61-4362-ae93-4b5d537eeb1e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:33.254564 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f910040c-aa61-4362-ae93-4b5d537eeb1e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:33.255281 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f910040c-aa61-4362-ae93-4b5d537eeb1e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:33.690086 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f910040c-aa61-4362-ae93-4b5d537eeb1e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:33.701749 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f910040c-aa61-4362-ae93-4b5d537eeb1e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.468531 Jul 25 16:28:33.706808 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 186/411] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:33 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:34.732923 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c204d831-8516-44ac-ab18-d48ae10a32ac tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:34.744306 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c204d831-8516-44ac-ab18-d48ae10a32ac tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:34.800936 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c204d831-8516-44ac-ab18-d48ae10a32ac tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:34.803759 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c204d831-8516-44ac-ab18-d48ae10a32ac tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:34.812337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c204d831-8516-44ac-ab18-d48ae10a32ac tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:34.826081 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c204d831-8516-44ac-ab18-d48ae10a32ac tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:35.309273 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c204d831-8516-44ac-ab18-d48ae10a32ac tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:35.324382 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c204d831-8516-44ac-ab18-d48ae10a32ac tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.602622 Jul 25 16:28:35.325677 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 226/412] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:34 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:36.360673 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65ef7618-dcc2-46f0-a318-0f78e4b7fc90 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:36.361628 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65ef7618-dcc2-46f0-a318-0f78e4b7fc90 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:36.396942 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65ef7618-dcc2-46f0-a318-0f78e4b7fc90 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:36.398339 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65ef7618-dcc2-46f0-a318-0f78e4b7fc90 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:36.399900 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65ef7618-dcc2-46f0-a318-0f78e4b7fc90 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:36.400940 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65ef7618-dcc2-46f0-a318-0f78e4b7fc90 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:36.711465 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-65ef7618-dcc2-46f0-a318-0f78e4b7fc90 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:36.731412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65ef7618-dcc2-46f0-a318-0f78e4b7fc90 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.373571 Jul 25 16:28:36.732580 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 187/413] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:36 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:37.771792 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-234ee7c8-72eb-46d2-b5ce-8a07a0c5daf1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:37.772957 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-234ee7c8-72eb-46d2-b5ce-8a07a0c5daf1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:37.792850 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=54 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:37.798434 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-234ee7c8-72eb-46d2-b5ce-8a07a0c5daf1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:37.801865 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-234ee7c8-72eb-46d2-b5ce-8a07a0c5daf1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:37.805141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-234ee7c8-72eb-46d2-b5ce-8a07a0c5daf1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:37.806337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-234ee7c8-72eb-46d2-b5ce-8a07a0c5daf1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:38.141508 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-234ee7c8-72eb-46d2-b5ce-8a07a0c5daf1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:38.158107 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-234ee7c8-72eb-46d2-b5ce-8a07a0c5daf1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.393685 Jul 25 16:28:38.170422 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 227/414] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:37 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:39.213006 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4118775-7876-48ed-a177-7421a75420f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:39.216249 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4118775-7876-48ed-a177-7421a75420f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:39.232268 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4118775-7876-48ed-a177-7421a75420f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:39.235617 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4118775-7876-48ed-a177-7421a75420f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:39.240369 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4118775-7876-48ed-a177-7421a75420f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:39.241208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4118775-7876-48ed-a177-7421a75420f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:39.689963 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d4118775-7876-48ed-a177-7421a75420f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:39.724408 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4118775-7876-48ed-a177-7421a75420f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.531192 Jul 25 16:28:39.726185 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 188/415] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:39 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:40.772618 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4904fd6d-fa32-4c17-930e-6df30715406d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:40.776730 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4904fd6d-fa32-4c17-930e-6df30715406d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:40.808315 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4904fd6d-fa32-4c17-930e-6df30715406d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:40.809130 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4904fd6d-fa32-4c17-930e-6df30715406d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:40.810636 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4904fd6d-fa32-4c17-930e-6df30715406d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:40.815197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4904fd6d-fa32-4c17-930e-6df30715406d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:41.361804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4904fd6d-fa32-4c17-930e-6df30715406d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:41.377314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4904fd6d-fa32-4c17-930e-6df30715406d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.614827 Jul 25 16:28:41.379141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 228/416] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:40 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:42.431384 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8cd7bc83-ac7a-45bb-bec6-e980fa0ddd03 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:42.434138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8cd7bc83-ac7a-45bb-bec6-e980fa0ddd03 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:42.447921 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cd7bc83-ac7a-45bb-bec6-e980fa0ddd03 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:42.449734 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cd7bc83-ac7a-45bb-bec6-e980fa0ddd03 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:42.461217 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cd7bc83-ac7a-45bb-bec6-e980fa0ddd03 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:42.462688 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cd7bc83-ac7a-45bb-bec6-e980fa0ddd03 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:42.744034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8cd7bc83-ac7a-45bb-bec6-e980fa0ddd03 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:42.756450 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8cd7bc83-ac7a-45bb-bec6-e980fa0ddd03 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.344256 Jul 25 16:28:42.757856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 189/417] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:42 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:43.793397 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-09d36784-94a2-427b-9e9c-fd330b6d5332 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:43.795677 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-09d36784-94a2-427b-9e9c-fd330b6d5332 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:43.810645 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09d36784-94a2-427b-9e9c-fd330b6d5332 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:43.811548 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09d36784-94a2-427b-9e9c-fd330b6d5332 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:43.812989 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09d36784-94a2-427b-9e9c-fd330b6d5332 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:43.814045 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09d36784-94a2-427b-9e9c-fd330b6d5332 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:44.022756 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-09d36784-94a2-427b-9e9c-fd330b6d5332 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:44.035150 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-09d36784-94a2-427b-9e9c-fd330b6d5332 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.247918 Jul 25 16:28:44.036057 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 229/418] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:43 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:45.061251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b243cfb5-3509-4980-8f85-1fa02b48397e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:45.062359 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b243cfb5-3509-4980-8f85-1fa02b48397e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:45.070239 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b243cfb5-3509-4980-8f85-1fa02b48397e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:45.070733 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b243cfb5-3509-4980-8f85-1fa02b48397e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:45.071547 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b243cfb5-3509-4980-8f85-1fa02b48397e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:45.072157 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b243cfb5-3509-4980-8f85-1fa02b48397e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:45.141709 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4207a4c9-0eb6-4f6a-b1be-4cc563cbbcb4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Action: 'create', calling method: .version_select at 0x7f44101a6f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1916605538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq8TkCT39VNQnZK++4SKF0Vr2RS4oNjB0h5nvZqTMc8sZd30kPE7cE+K+aVCBipIjqcsrVw6Q3R91VBrVsThs+M+AMGZySEdE9+tw2EZeq4F7YUSlMeTubqvUQ0rFXJEw=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:45.183218 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-4207a4c9-0eb6-4f6a-b1be-4cc563cbbcb4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Getting quotas for project 90317adf2c86461d96439dc48441b6c8. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:28:45.189624 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-4207a4c9-0eb6-4f6a-b1be-4cc563cbbcb4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Getting quotas for user 6a52a93774cd48868f9b5656821b0f12 and project 90317adf2c86461d96439dc48441b6c8. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:28:45.240527 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4207a4c9-0eb6-4f6a-b1be-4cc563cbbcb4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.388114 Jul 25 16:28:45.241738 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 190/419] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:28:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:28:45.313727 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b243cfb5-3509-4980-8f85-1fa02b48397e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:45.323546 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b243cfb5-3509-4980-8f85-1fa02b48397e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.266416 Jul 25 16:28:45.324611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 230/420] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:45 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:46.359671 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-59c37b9a-e9c7-4dd6-80a5-a3134f9f7767 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:46.360796 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-59c37b9a-e9c7-4dd6-80a5-a3134f9f7767 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:46.377945 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59c37b9a-e9c7-4dd6-80a5-a3134f9f7767 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:46.379287 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59c37b9a-e9c7-4dd6-80a5-a3134f9f7767 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:46.381138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59c37b9a-e9c7-4dd6-80a5-a3134f9f7767 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:46.382490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-59c37b9a-e9c7-4dd6-80a5-a3134f9f7767 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:46.430719 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:46.655549 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-59c37b9a-e9c7-4dd6-80a5-a3134f9f7767 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:46.682103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-59c37b9a-e9c7-4dd6-80a5-a3134f9f7767 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.331606 Jul 25 16:28:46.683402 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 191/421] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:46 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:47.713649 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2521dd1e-bc1c-47ea-af9d-7c36e505fe66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:47.714474 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2521dd1e-bc1c-47ea-af9d-7c36e505fe66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:47.724050 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2521dd1e-bc1c-47ea-af9d-7c36e505fe66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:47.724495 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2521dd1e-bc1c-47ea-af9d-7c36e505fe66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:47.725789 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2521dd1e-bc1c-47ea-af9d-7c36e505fe66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:47.726286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2521dd1e-bc1c-47ea-af9d-7c36e505fe66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:47.935034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2521dd1e-bc1c-47ea-af9d-7c36e505fe66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:47.944017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2521dd1e-bc1c-47ea-af9d-7c36e505fe66 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.235691 Jul 25 16:28:47.944673 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 231/422] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:47 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:48.971891 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb759cae-da3b-46bf-8e25-627be9aa6e9f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:48.972947 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb759cae-da3b-46bf-8e25-627be9aa6e9f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:48.984936 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb759cae-da3b-46bf-8e25-627be9aa6e9f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:48.986021 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb759cae-da3b-46bf-8e25-627be9aa6e9f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:48.987252 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb759cae-da3b-46bf-8e25-627be9aa6e9f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:48.988175 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb759cae-da3b-46bf-8e25-627be9aa6e9f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:49.246070 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb759cae-da3b-46bf-8e25-627be9aa6e9f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:49.267446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb759cae-da3b-46bf-8e25-627be9aa6e9f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.303387 Jul 25 16:28:49.268683 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 192/423] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:48 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:50.318808 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-58b83d88-f66d-4188-951d-af16e9895106 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:50.330418 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-58b83d88-f66d-4188-951d-af16e9895106 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:50.347886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58b83d88-f66d-4188-951d-af16e9895106 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:50.350022 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58b83d88-f66d-4188-951d-af16e9895106 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:50.352857 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58b83d88-f66d-4188-951d-af16e9895106 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:50.355708 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58b83d88-f66d-4188-951d-af16e9895106 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:50.631572 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-58b83d88-f66d-4188-951d-af16e9895106 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:50.643152 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-58b83d88-f66d-4188-951d-af16e9895106 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.343266 Jul 25 16:28:50.644091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 232/424] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:50 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:51.679567 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-297eba0c-49c1-4c80-a67f-046f91a37432 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:51.680692 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-297eba0c-49c1-4c80-a67f-046f91a37432 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:51.691394 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-297eba0c-49c1-4c80-a67f-046f91a37432 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:51.691987 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-297eba0c-49c1-4c80-a67f-046f91a37432 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:51.693298 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-297eba0c-49c1-4c80-a67f-046f91a37432 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:51.694215 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-297eba0c-49c1-4c80-a67f-046f91a37432 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:51.961052 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-297eba0c-49c1-4c80-a67f-046f91a37432 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:51.971616 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-297eba0c-49c1-4c80-a67f-046f91a37432 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1737 microversion: 2.1 time: 0.298512 Jul 25 16:28:51.972423 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 193/425] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:51 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:53.000844 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-746a6960-3481-4452-9148-08339fc368f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:53.001648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-746a6960-3481-4452-9148-08339fc368f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:53.012411 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-746a6960-3481-4452-9148-08339fc368f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.013188 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-746a6960-3481-4452-9148-08339fc368f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.014640 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-746a6960-3481-4452-9148-08339fc368f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.015468 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-746a6960-3481-4452-9148-08339fc368f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.241330 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-746a6960-3481-4452-9148-08339fc368f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:53.257252 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-746a6960-3481-4452-9148-08339fc368f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1717 microversion: 2.1 time: 0.264858 Jul 25 16:28:53.258126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 233/426] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:52 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1717 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:53.469058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:53.470047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:53.480635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.481077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.482170 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.482908 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.743707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] HTTP exception thrown: Cannot 'detach_volume' instance 931c107b-f645-476f-9b81-2dab0fedf218 while it is in vm_state rescued Jul 25 16:28:53.745201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c3b9803a-541d-43b4-8924-ab4d0eb9f2c2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:53.745973 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c3b9803a-541d-43b4-8924-ab4d0eb9f2c2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Request method failure captured: Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments/d04e95cf-f570-43ce-b518-84c752ca5335 HTTP/1.1 Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sPKb9Fb-vH6xnT2mTjLGFd_QOBpmsX1Y8Rb9D03weDBhasNylRXYbFmkU2x6iERYZs7_9KM7dgcaOtpoTwNfAqLh_Na3tcjAOtL2BmuoAUQGulpjfzj19IPXftQo2eRfFhz3u8oML9jDvt8ZBdSwS3KFDldQI-3LKks8yVzk6uD41w Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:28:53.747293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18b6e0eaf4eb48868a683c7769d3df7a"}]}] Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 2d1eb89923784f1c83d2077c6b6926e9 Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:28:53.750273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Cannot 'detach_volume' instance 931c107b-f645-476f-9b81-2dab0fedf218 while it is in vm_state rescued Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '931c107b-f645-476f-9b81-2dab0fedf218', 'id': 'd04e95cf-f570-43ce-b518-84c752ca5335'} Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 931c107b-f645-476f-9b81-2dab0fedf218 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:28:53.752961 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 931c107b-f645-476f-9b81-2dab0fedf218 while it is in vm_state rescued Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 931c107b-f645-476f-9b81-2dab0fedf218 while it is in vm_state rescued Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:28:53.755660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Returning 409 to user: Cannot 'detach_volume' instance 931c107b-f645-476f-9b81-2dab0fedf218 while it is in vm_state rescued {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:28:53.757814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-75bcbfc4-c13f-4aea-a954-7f31cde5c5f6 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "DELETE /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments/d04e95cf-f570-43ce-b518-84c752ca5335" status: 409 len: 152 microversion: 2.1 time: 0.288415 Jul 25 16:28:53.757814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 194/427] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:28:53 2022] DELETE /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments/d04e95cf-f570-43ce-b518-84c752ca5335 => generated 152 bytes in 291 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 16:28:53.758116 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b9803a-541d-43b4-8924-ab4d0eb9f2c2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.758116 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b9803a-541d-43b4-8924-ab4d0eb9f2c2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.759013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b9803a-541d-43b4-8924-ab4d0eb9f2c2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.759713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c3b9803a-541d-43b4-8924-ab4d0eb9f2c2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.767362 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bebfa3d9-f34d-401c-a75d-7b8fee09e59c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:28:53.768196 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bebfa3d9-f34d-401c-a75d-7b8fee09e59c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:53.782379 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bebfa3d9-f34d-401c-a75d-7b8fee09e59c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.783164 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bebfa3d9-f34d-401c-a75d-7b8fee09e59c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.784612 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bebfa3d9-f34d-401c-a75d-7b8fee09e59c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.785444 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bebfa3d9-f34d-401c-a75d-7b8fee09e59c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.898230 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-c3b9803a-541d-43b4-8924-ab4d0eb9f2c2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lazy-loading 'services' on Instance uuid c7e15a0f-ed99-4348-98a3-10a6a91e7d3c {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:28:53.926171 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bebfa3d9-f34d-401c-a75d-7b8fee09e59c tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "POST /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/action" status: 202 len: 0 microversion: 2.1 time: 0.164963 Jul 25 16:28:53.932458 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 195/428] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:28:53 2022] POST /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:28:53.943548 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e82e035d-dba5-4920-b1ef-39df1a62686a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:53.945155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e82e035d-dba5-4920-b1ef-39df1a62686a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:53.955999 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e82e035d-dba5-4920-b1ef-39df1a62686a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.956732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e82e035d-dba5-4920-b1ef-39df1a62686a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:53.957831 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e82e035d-dba5-4920-b1ef-39df1a62686a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:53.958762 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e82e035d-dba5-4920-b1ef-39df1a62686a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:54.014004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c3b9803a-541d-43b4-8924-ab4d0eb9f2c2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c/os-volume_attachments/0ef76f66-0049-45a6-85e6-a1fbc92423e8" status: 202 len: 0 microversion: 2.1 time: 0.276414 Jul 25 16:28:54.015942 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 234/429] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:28:53 2022] DELETE /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c/os-volume_attachments/0ef76f66-0049-45a6-85e6-a1fbc92423e8 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:28:54.235632 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e82e035d-dba5-4920-b1ef-39df1a62686a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:54.254630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e82e035d-dba5-4920-b1ef-39df1a62686a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1725 microversion: 2.1 time: 0.319119 Jul 25 16:28:54.255693 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 196/430] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:53 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1725 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:55.258518 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2546903c-9c3e-4be3-8a45-fe57c988555a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:55.259417 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2546903c-9c3e-4be3-8a45-fe57c988555a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:55.268797 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2546903c-9c3e-4be3-8a45-fe57c988555a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:55.269685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2546903c-9c3e-4be3-8a45-fe57c988555a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:55.270911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2546903c-9c3e-4be3-8a45-fe57c988555a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:55.271667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2546903c-9c3e-4be3-8a45-fe57c988555a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:55.275497 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:55.278933 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d3bac43b-8de6-429e-a974-1db36ecbe09e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:55.280967 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d3bac43b-8de6-429e-a974-1db36ecbe09e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:55.286398 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:55.296188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3bac43b-8de6-429e-a974-1db36ecbe09e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:55.296906 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3bac43b-8de6-429e-a974-1db36ecbe09e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:55.298199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3bac43b-8de6-429e-a974-1db36ecbe09e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:55.298920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d3bac43b-8de6-429e-a974-1db36ecbe09e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:55.315420 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2546903c-9c3e-4be3-8a45-fe57c988555a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:28:55.425462 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2546903c-9c3e-4be3-8a45-fe57c988555a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 204 len: 0 microversion: 2.1 time: 0.172259 Jul 25 16:28:55.426495 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 235/431] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:28:55 2022] DELETE /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:28:55.440947 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-30f6aa78-8854-4371-b9c9-f15d8a165601 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:55.442146 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-30f6aa78-8854-4371-b9c9-f15d8a165601 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:55.454020 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30f6aa78-8854-4371-b9c9-f15d8a165601 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:55.454835 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30f6aa78-8854-4371-b9c9-f15d8a165601 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:55.456960 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30f6aa78-8854-4371-b9c9-f15d8a165601 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:55.456960 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-30f6aa78-8854-4371-b9c9-f15d8a165601 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:55.498053 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d3bac43b-8de6-429e-a974-1db36ecbe09e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:55.506912 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d3bac43b-8de6-429e-a974-1db36ecbe09e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1725 microversion: 2.1 time: 0.233199 Jul 25 16:28:55.507500 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 197/432] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:55 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:55.649880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-30f6aa78-8854-4371-b9c9-f15d8a165601 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:55.659084 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-30f6aa78-8854-4371-b9c9-f15d8a165601 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1512 microversion: 2.1 time: 0.225610 Jul 25 16:28:55.659768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 236/433] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:55 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:56.532821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d051a84a-4b54-48dc-9661-071cb6ade71e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:56.533931 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d051a84a-4b54-48dc-9661-071cb6ade71e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:56.536722 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:28:56.548576 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d051a84a-4b54-48dc-9661-071cb6ade71e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.549539 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d051a84a-4b54-48dc-9661-071cb6ade71e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.551208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d051a84a-4b54-48dc-9661-071cb6ade71e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.552110 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d051a84a-4b54-48dc-9661-071cb6ade71e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.687803 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4ce18358-a96a-4290-9646-6fda9a6ff5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:56.690280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4ce18358-a96a-4290-9646-6fda9a6ff5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:56.703424 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ce18358-a96a-4290-9646-6fda9a6ff5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.703873 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ce18358-a96a-4290-9646-6fda9a6ff5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.704770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ce18358-a96a-4290-9646-6fda9a6ff5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:56.705219 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4ce18358-a96a-4290-9646-6fda9a6ff5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:56.847343 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d051a84a-4b54-48dc-9661-071cb6ade71e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:56.858760 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d051a84a-4b54-48dc-9661-071cb6ade71e tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1725 microversion: 2.1 time: 0.333006 Jul 25 16:28:56.859474 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 198/434] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:56 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:56.970796 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4ce18358-a96a-4290-9646-6fda9a6ff5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:56.979971 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4ce18358-a96a-4290-9646-6fda9a6ff5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1512 microversion: 2.1 time: 0.299515 Jul 25 16:28:56.980586 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 237/435] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:56 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:57.888555 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-acf819e6-2b57-4fb5-a316-a22d0c969d81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:57.889676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-acf819e6-2b57-4fb5-a316-a22d0c969d81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:57.898572 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-acf819e6-2b57-4fb5-a316-a22d0c969d81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:57.899217 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-acf819e6-2b57-4fb5-a316-a22d0c969d81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:57.900211 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-acf819e6-2b57-4fb5-a316-a22d0c969d81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:57.900713 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-acf819e6-2b57-4fb5-a316-a22d0c969d81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.008124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6828f422-7225-4253-8a79-a0ccf1208628 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:58.009737 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6828f422-7225-4253-8a79-a0ccf1208628 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:58.022430 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6828f422-7225-4253-8a79-a0ccf1208628 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.022985 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6828f422-7225-4253-8a79-a0ccf1208628 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.024235 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6828f422-7225-4253-8a79-a0ccf1208628 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:58.025549 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6828f422-7225-4253-8a79-a0ccf1208628 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:58.180309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-acf819e6-2b57-4fb5-a316-a22d0c969d81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:58.189988 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-acf819e6-2b57-4fb5-a316-a22d0c969d81 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1725 microversion: 2.1 time: 0.306224 Jul 25 16:28:58.190906 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 199/436] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:57 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:58.265436 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6828f422-7225-4253-8a79-a0ccf1208628 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:58.280905 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6828f422-7225-4253-8a79-a0ccf1208628 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1512 microversion: 2.1 time: 0.280226 Jul 25 16:28:58.282085 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 238/437] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:57 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:59.220776 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-921a5f40-9504-4a07-9bd4-59fab083ba42 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:59.222442 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-921a5f40-9504-4a07-9bd4-59fab083ba42 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:59.233684 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-921a5f40-9504-4a07-9bd4-59fab083ba42 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.234491 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-921a5f40-9504-4a07-9bd4-59fab083ba42 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.235978 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-921a5f40-9504-4a07-9bd4-59fab083ba42 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.236447 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-921a5f40-9504-4a07-9bd4-59fab083ba42 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.322223 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d4f76837-0d03-4ffe-98d9-21053a0eb5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:59.323442 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d4f76837-0d03-4ffe-98d9-21053a0eb5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:59.331572 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4f76837-0d03-4ffe-98d9-21053a0eb5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.331980 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4f76837-0d03-4ffe-98d9-21053a0eb5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.333382 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4f76837-0d03-4ffe-98d9-21053a0eb5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.333838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d4f76837-0d03-4ffe-98d9-21053a0eb5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.500023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-921a5f40-9504-4a07-9bd4-59fab083ba42 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:59.520409 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-921a5f40-9504-4a07-9bd4-59fab083ba42 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1731 microversion: 2.1 time: 0.305753 Jul 25 16:28:59.521469 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 200/438] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:59 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:28:59.556635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f76d386-d8b7-4514-96f8-307329a3fbc3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:28:59.557526 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f76d386-d8b7-4514-96f8-307329a3fbc3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:28:59.565592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f76d386-d8b7-4514-96f8-307329a3fbc3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.566452 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f76d386-d8b7-4514-96f8-307329a3fbc3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.568416 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f76d386-d8b7-4514-96f8-307329a3fbc3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:28:59.569277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f76d386-d8b7-4514-96f8-307329a3fbc3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:28:59.579489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d4f76837-0d03-4ffe-98d9-21053a0eb5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:28:59.593451 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d4f76837-0d03-4ffe-98d9-21053a0eb5b8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1512 microversion: 2.1 time: 0.277218 Jul 25 16:28:59.596738 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 239/439] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:28:59 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:28:59.706243 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f76d386-d8b7-4514-96f8-307329a3fbc3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153872 Jul 25 16:28:59.707460 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 201/440] 10.222.0.66 () {58 vars in 1275 bytes} [Mon Jul 25 16:28:59 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:00.121964 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-5d145179-7e1d-49a5-890d-aa62ee836def req-d545b63c-6daf-47a0-bcb4-7d95c9f7c2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e15a0f-ed99-4348-98a3-10a6a91e7d3c", "name": "network-vif-deleted", "tag": "c088b66c-9e47-45df-a77e-878bab58d1aa"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:00.140991 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5d145179-7e1d-49a5-890d-aa62ee836def req-d545b63c-6daf-47a0-bcb4-7d95c9f7c2d1 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:00.142369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-5d145179-7e1d-49a5-890d-aa62ee836def req-d545b63c-6daf-47a0-bcb4-7d95c9f7c2d1 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.164443 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-5d145179-7e1d-49a5-890d-aa62ee836def req-d545b63c-6daf-47a0-bcb4-7d95c9f7c2d1 service nova] Creating event network-vif-deleted:c088b66c-9e47-45df-a77e-878bab58d1aa for instance c7e15a0f-ed99-4348-98a3-10a6a91e7d3c on hv-cinder-83697 Jul 25 16:29:00.172343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-5d145179-7e1d-49a5-890d-aa62ee836def req-d545b63c-6daf-47a0-bcb4-7d95c9f7c2d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056644 Jul 25 16:29:00.173457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 240/441] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:00.640019 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:00.641156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:00.653150 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:00.654487 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.655933 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:00.656835 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.717947 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:00.723018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:00.724170 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lazy-loading 'fault' on Instance uuid c7e15a0f-ed99-4348-98a3-10a6a91e7d3c {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:00.869650 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:00.899188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c84c970e-c385-4f56-8bf5-c5b2cfc851a2 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 200 len: 1308 microversion: 2.1 time: 0.267451 Jul 25 16:29:00.899959 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 202/442] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:00 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:01.227406 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-c93e29eb-8db6-40a8-aea6-7e0263f476b9 req-72936ebd-9565-423e-8742-d8c34d153a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c107b-f645-476f-9b81-2dab0fedf218", "tag": "fb6733bd-e84d-4ca0-9190-079f0bc896c0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:01.239464 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c93e29eb-8db6-40a8-aea6-7e0263f476b9 req-72936ebd-9565-423e-8742-d8c34d153a02 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:01.239909 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c93e29eb-8db6-40a8-aea6-7e0263f476b9 req-72936ebd-9565-423e-8742-d8c34d153a02 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:01.254983 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-c93e29eb-8db6-40a8-aea6-7e0263f476b9 req-72936ebd-9565-423e-8742-d8c34d153a02 service nova] Creating event network-changed:fb6733bd-e84d-4ca0-9190-079f0bc896c0 for instance 931c107b-f645-476f-9b81-2dab0fedf218 on hv-cinder-83697 Jul 25 16:29:01.261620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-c93e29eb-8db6-40a8-aea6-7e0263f476b9 req-72936ebd-9565-423e-8742-d8c34d153a02 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042438 Jul 25 16:29:01.262182 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 241/443] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:01.937434 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:01.939401 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: c7e15a0f-ed99-4348-98a3-10a6a91e7d3c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:01.957807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:01.958336 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:01.959211 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:01.960754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:01.978524 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] HTTP exception thrown: Instance c7e15a0f-ed99-4348-98a3-10a6a91e7d3c could not be found. Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Request method failure captured: Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c HTTP/1.1 Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sRgFZidPOzhQSHuudUzvaAz8ZQKm3_5Gc-EubNPMZAOpCzA8AdwhwjS01bFxU6eXIbe6OoH2_Ud3rE_Hv5lRZbKcIonrvZmzhH4Ed5FiUSutDtf6EbT_lGFVzY3MK1nAQReqcaN-ddoXEbk3P70EAp8JrI5Zi1rEhH55PoBNHlS2Oo Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: bd9b5f7127564335a847ab40761124df Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesSnapshotTestJSON-248873339 Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:29:01.981949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bd9b5f7127564335a847ab40761124df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd9b5f7127564335a847ab40761124df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd9b5f7127564335a847ab40761124df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bd9b5f7127564335a847ab40761124df"}]}] Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesSnapshotTestJSON-248873339 Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: bd9b5f7127564335a847ab40761124df Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-248873339 Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesSnapshotTestJSON-248873339-project Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: c7e1898925cd4feea900627bc0ee8a7a Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesSnapshotTestJSON-248873339-project Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance c7e15a0f-ed99-4348-98a3-10a6a91e7d3c could not be found. Jul 25 16:29:01.983585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'c7e15a0f-ed99-4348-98a3-10a6a91e7d3c'} Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e15a0f-ed99-4348-98a3-10a6a91e7d3c could not be found. Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:01.984630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e15a0f-ed99-4348-98a3-10a6a91e7d3c could not be found. Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e15a0f-ed99-4348-98a3-10a6a91e7d3c could not be found. Jul 25 16:29:01.990459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:01.992678 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Returning 404 to user: Instance c7e15a0f-ed99-4348-98a3-10a6a91e7d3c could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:01.992678 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-25529c1c-59c1-4fa6-a10f-5bf0f2735e86 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c" status: 404 len: 111 microversion: 2.1 time: 0.059793 Jul 25 16:29:01.992678 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 203/444] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:01 2022] GET /compute/v2.1/servers/c7e15a0f-ed99-4348-98a3-10a6a91e7d3c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:03.284030 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-04a06684-841f-42c6-b826-282398903457 req-6b76c5dc-3b0a-499c-95f5-9bca100b18c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "931c107b-f645-476f-9b81-2dab0fedf218", "tag": "fb6733bd-e84d-4ca0-9190-079f0bc896c0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:03.301405 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-04a06684-841f-42c6-b826-282398903457 req-6b76c5dc-3b0a-499c-95f5-9bca100b18c0 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:03.302115 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-04a06684-841f-42c6-b826-282398903457 req-6b76c5dc-3b0a-499c-95f5-9bca100b18c0 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:03.326611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-04a06684-841f-42c6-b826-282398903457 req-6b76c5dc-3b0a-499c-95f5-9bca100b18c0 service nova] Creating event network-changed:fb6733bd-e84d-4ca0-9190-079f0bc896c0 for instance 931c107b-f645-476f-9b81-2dab0fedf218 on hv-cinder-83697 Jul 25 16:29:03.336932 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-04a06684-841f-42c6-b826-282398903457 req-6b76c5dc-3b0a-499c-95f5-9bca100b18c0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059432 Jul 25 16:29:03.338065 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 242/445] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:06.038967 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5d2c3d84-83e0-4c70-84d6-5adb74e93bfb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:06.043414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5d2c3d84-83e0-4c70-84d6-5adb74e93bfb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:06.056041 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d2c3d84-83e0-4c70-84d6-5adb74e93bfb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.056892 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d2c3d84-83e0-4c70-84d6-5adb74e93bfb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.058431 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d2c3d84-83e0-4c70-84d6-5adb74e93bfb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.059233 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5d2c3d84-83e0-4c70-84d6-5adb74e93bfb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.213149 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5d2c3d84-83e0-4c70-84d6-5adb74e93bfb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "POST /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/action" status: 202 len: 0 microversion: 2.1 time: 0.181698 Jul 25 16:29:06.214087 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 204/446] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:29:06 2022] POST /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:29:06.231260 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d7243659-0e03-4cb2-a84f-4381ff3007f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:06.232608 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d7243659-0e03-4cb2-a84f-4381ff3007f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:06.248105 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7243659-0e03-4cb2-a84f-4381ff3007f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.248716 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7243659-0e03-4cb2-a84f-4381ff3007f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.249702 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7243659-0e03-4cb2-a84f-4381ff3007f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:06.250668 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d7243659-0e03-4cb2-a84f-4381ff3007f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:06.515463 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d7243659-0e03-4cb2-a84f-4381ff3007f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:06.527795 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d7243659-0e03-4cb2-a84f-4381ff3007f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1751 microversion: 2.1 time: 0.305423 Jul 25 16:29:06.529627 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 243/447] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:06 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1751 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:07.565187 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96157853-c9fe-48e6-a329-8779f3e3bbcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:07.566064 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96157853-c9fe-48e6-a329-8779f3e3bbcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:07.574489 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96157853-c9fe-48e6-a329-8779f3e3bbcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:07.575258 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96157853-c9fe-48e6-a329-8779f3e3bbcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:07.576249 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96157853-c9fe-48e6-a329-8779f3e3bbcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:07.576867 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96157853-c9fe-48e6-a329-8779f3e3bbcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:07.841867 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96157853-c9fe-48e6-a329-8779f3e3bbcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:07.857186 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96157853-c9fe-48e6-a329-8779f3e3bbcb tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1756 microversion: 2.1 time: 0.297233 Jul 25 16:29:07.858319 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 205/448] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:07 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1756 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:08.392016 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1730012712", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1916605538", "security_groups": [{"name": "tempest-secgroup-smoke-1687340872"}], "networks": [{"uuid": "120c8944-cc34-4fa8-988b-27a538aee072"}], "block_device_mapping_v2": [{"uuid": "320ce1e7-0403-4f4c-bda2-35678b855849", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:08.413075 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:08.594090 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] validate_networks() for [('120c8944-cc34-4fa8-988b-27a538aee072', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:29:08.899073 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-03bf7e38-e8c1-4d1b-a5ba-e69c2835590a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:08.900115 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-03bf7e38-e8c1-4d1b-a5ba-e69c2835590a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:08.912930 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03bf7e38-e8c1-4d1b-a5ba-e69c2835590a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:08.913764 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03bf7e38-e8c1-4d1b-a5ba-e69c2835590a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:08.915204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03bf7e38-e8c1-4d1b-a5ba-e69c2835590a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:08.915938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03bf7e38-e8c1-4d1b-a5ba-e69c2835590a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:08.945379 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:09.473713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:29:09.474608 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:29:09.475719 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:29:09.476655 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:29:09.477979 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:29:09.493736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-03bf7e38-e8c1-4d1b-a5ba-e69c2835590a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:09.496965 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:09.497839 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:09.499436 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:09.500229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:09.509113 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-03bf7e38-e8c1-4d1b-a5ba-e69c2835590a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1756 microversion: 2.1 time: 0.617823 Jul 25 16:29:09.510485 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 206/449] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:08 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1756 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:09.537445 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Getting quotas for project 90317adf2c86461d96439dc48441b6c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:29:09.547037 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Getting quotas for user 6a52a93774cd48868f9b5656821b0f12 and project 90317adf2c86461d96439dc48441b6c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:29:09.670334 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:29:09.675069 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='320ce1e7-0403-4f4c-bda2-35678b855849',volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:29:09.878493 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-06a058ec-723e-4b24-a048-7b6b3154b114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.494376 Jul 25 16:29:09.879512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 244/450] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:29:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:29:09.893669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-45dfee0a-d86a-4593-a6f7-e904bd07143a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:09.895346 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-45dfee0a-d86a-4593-a6f7-e904bd07143a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:09.976082 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-45dfee0a-d86a-4593-a6f7-e904bd07143a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:09.986141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-45dfee0a-d86a-4593-a6f7-e904bd07143a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1089 microversion: 2.1 time: 0.098167 Jul 25 16:29:09.986923 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 207/451] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:09 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1089 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:10.546071 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-186aed02-25f9-42b2-ba73-629e677b5011 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:10.547221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-186aed02-25f9-42b2-ba73-629e677b5011 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:10.560770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-186aed02-25f9-42b2-ba73-629e677b5011 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:10.561596 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-186aed02-25f9-42b2-ba73-629e677b5011 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:10.563025 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-186aed02-25f9-42b2-ba73-629e677b5011 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:10.563771 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-186aed02-25f9-42b2-ba73-629e677b5011 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:10.815110 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-186aed02-25f9-42b2-ba73-629e677b5011 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:10.831363 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-186aed02-25f9-42b2-ba73-629e677b5011 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1756 microversion: 2.1 time: 0.292572 Jul 25 16:29:10.832437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 245/452] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:10 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1756 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:11.026057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a453b31d-493e-4102-8fca-3f9ad32f14b1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:11.027102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a453b31d-493e-4102-8fca-3f9ad32f14b1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:11.037119 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a453b31d-493e-4102-8fca-3f9ad32f14b1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.037767 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a453b31d-493e-4102-8fca-3f9ad32f14b1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:11.038821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a453b31d-493e-4102-8fca-3f9ad32f14b1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.039375 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a453b31d-493e-4102-8fca-3f9ad32f14b1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:11.158330 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a453b31d-493e-4102-8fca-3f9ad32f14b1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:11.173629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a453b31d-493e-4102-8fca-3f9ad32f14b1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1139 microversion: 2.1 time: 0.153976 Jul 25 16:29:11.174719 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 208/453] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:11 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1139 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:11.527823 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2044194768", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "networks": [{"uuid": "fbc95ce4-7af4-4dc6-9cb6-7699309ac513"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:11.623305 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] validate_networks() for [('fbc95ce4-7af4-4dc6-9cb6-7699309ac513', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:29:11.877117 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5582dea2-e362-4a93-b10a-fa4cc10927ae tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:11.877947 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5582dea2-e362-4a93-b10a-fa4cc10927ae tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:11.900313 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5582dea2-e362-4a93-b10a-fa4cc10927ae tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.900812 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5582dea2-e362-4a93-b10a-fa4cc10927ae tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:11.903896 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5582dea2-e362-4a93-b10a-fa4cc10927ae tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:11.904451 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5582dea2-e362-4a93-b10a-fa4cc10927ae tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.391102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5582dea2-e362-4a93-b10a-fa4cc10927ae tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:12.408454 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5582dea2-e362-4a93-b10a-fa4cc10927ae tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1756 microversion: 2.1 time: 0.543281 Jul 25 16:29:12.429672 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 209/454] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:11 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1756 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:12.448070 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-671098cb-8002-443d-b088-fbf2f01a07d4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:12.448970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-671098cb-8002-443d-b088-fbf2f01a07d4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:12.460819 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-671098cb-8002-443d-b088-fbf2f01a07d4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.461871 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-671098cb-8002-443d-b088-fbf2f01a07d4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.465219 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-671098cb-8002-443d-b088-fbf2f01a07d4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.466204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-671098cb-8002-443d-b088-fbf2f01a07d4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.473025 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:29:12.474782 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:29:12.476274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:29:12.477673 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:29:12.478940 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:29:12.496393 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.496987 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.498018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:12.498799 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:12.525897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Getting quotas for project bd9b5f7127564335a847ab40761124df. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:29:12.547976 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Getting quotas for user c7e1898925cd4feea900627bc0ee8a7a and project bd9b5f7127564335a847ab40761124df. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:29:12.564581 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:29:12.567465 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:29:12.576711 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-671098cb-8002-443d-b088-fbf2f01a07d4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:12.595671 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-671098cb-8002-443d-b088-fbf2f01a07d4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1205 microversion: 2.1 time: 0.162893 Jul 25 16:29:12.598252 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 210/455] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:12 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1205 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:12.658274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-488bd34d-f47c-494c-a12b-5614e955c1a7 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.138030 Jul 25 16:29:12.660712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 246/456] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:29:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:29:12.681432 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d88e615-dee2-4bd5-9628-e1d89d1588a0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:12.684903 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7d88e615-dee2-4bd5-9628-e1d89d1588a0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:12.836520 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7d88e615-dee2-4bd5-9628-e1d89d1588a0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:12.849043 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7d88e615-dee2-4bd5-9628-e1d89d1588a0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1219 microversion: 2.1 time: 0.175082 Jul 25 16:29:12.850247 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 211/457] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:12 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:13.465535 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b97cfbec-e3db-42d7-8d6f-98378d12347f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:13.467079 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b97cfbec-e3db-42d7-8d6f-98378d12347f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:13.487517 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b97cfbec-e3db-42d7-8d6f-98378d12347f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.488496 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b97cfbec-e3db-42d7-8d6f-98378d12347f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.489710 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b97cfbec-e3db-42d7-8d6f-98378d12347f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.490403 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b97cfbec-e3db-42d7-8d6f-98378d12347f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.634218 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5284a9c6-5413-4b53-984e-1fca00e49636 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:13.638168 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5284a9c6-5413-4b53-984e-1fca00e49636 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:13.654634 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5284a9c6-5413-4b53-984e-1fca00e49636 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.655609 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5284a9c6-5413-4b53-984e-1fca00e49636 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.657649 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5284a9c6-5413-4b53-984e-1fca00e49636 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.660038 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5284a9c6-5413-4b53-984e-1fca00e49636 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.902594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b97cfbec-e3db-42d7-8d6f-98378d12347f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:13.927340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b97cfbec-e3db-42d7-8d6f-98378d12347f tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1756 microversion: 2.1 time: 0.469955 Jul 25 16:29:13.933139 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 247/458] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:13 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1756 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:13.940705 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-996dfb34-9a4e-44ff-8ca7-880032a02fcf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:13.941660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-996dfb34-9a4e-44ff-8ca7-880032a02fcf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:13.953478 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-996dfb34-9a4e-44ff-8ca7-880032a02fcf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.954691 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-996dfb34-9a4e-44ff-8ca7-880032a02fcf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:13.956480 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-996dfb34-9a4e-44ff-8ca7-880032a02fcf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:13.961100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-996dfb34-9a4e-44ff-8ca7-880032a02fcf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.087761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5284a9c6-5413-4b53-984e-1fca00e49636 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:14.126121 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5284a9c6-5413-4b53-984e-1fca00e49636 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.501307 Jul 25 16:29:14.127143 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-996dfb34-9a4e-44ff-8ca7-880032a02fcf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:14.127437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 212/459] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:13 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:14.140161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-adc0d774-b309-4c03-a72f-9d5d79eca537 req-34812a1b-de6e-48e0-86a6-82fc2dafdcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb", "tag": "54cf1201-fdc0-44ce-bc59-698ade1f2c99"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:14.140808 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-996dfb34-9a4e-44ff-8ca7-880032a02fcf tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1271 microversion: 2.1 time: 0.205871 Jul 25 16:29:14.155553 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 248/460] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:13 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:14.163056 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-adc0d774-b309-4c03-a72f-9d5d79eca537 req-34812a1b-de6e-48e0-86a6-82fc2dafdcb2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:14.163407 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-adc0d774-b309-4c03-a72f-9d5d79eca537 req-34812a1b-de6e-48e0-86a6-82fc2dafdcb2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.186869 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-adc0d774-b309-4c03-a72f-9d5d79eca537 req-34812a1b-de6e-48e0-86a6-82fc2dafdcb2 service nova] Creating event network-changed:54cf1201-fdc0-44ce-bc59-698ade1f2c99 for instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb on hv-cinder-83697 Jul 25 16:29:14.194432 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-adc0d774-b309-4c03-a72f-9d5d79eca537 req-34812a1b-de6e-48e0-86a6-82fc2dafdcb2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064951 Jul 25 16:29:14.198999 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 213/461] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:14.963267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-48bb5e26-28f5-4d13-aebd-39b8a65a4547 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:14.964414 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-48bb5e26-28f5-4d13-aebd-39b8a65a4547 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:14.976328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48bb5e26-28f5-4d13-aebd-39b8a65a4547 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:14.977105 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48bb5e26-28f5-4d13-aebd-39b8a65a4547 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:14.978687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48bb5e26-28f5-4d13-aebd-39b8a65a4547 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:14.979479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-48bb5e26-28f5-4d13-aebd-39b8a65a4547 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.163975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-441cc767-22c0-4c31-99b9-1bd4a44582a8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:15.166349 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-441cc767-22c0-4c31-99b9-1bd4a44582a8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:15.178934 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-441cc767-22c0-4c31-99b9-1bd4a44582a8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.179928 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-441cc767-22c0-4c31-99b9-1bd4a44582a8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.181429 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-441cc767-22c0-4c31-99b9-1bd4a44582a8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.182252 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-441cc767-22c0-4c31-99b9-1bd4a44582a8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.257959 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-48bb5e26-28f5-4d13-aebd-39b8a65a4547 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:15.272646 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-48bb5e26-28f5-4d13-aebd-39b8a65a4547 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1756 microversion: 2.1 time: 0.316251 Jul 25 16:29:15.273713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 249/462] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:14 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1756 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:15.283044 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4c7882b1-d384-44fb-8d95-57c8db118f2b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:15.285933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4c7882b1-d384-44fb-8d95-57c8db118f2b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:15.299197 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7882b1-d384-44fb-8d95-57c8db118f2b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.300339 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7882b1-d384-44fb-8d95-57c8db118f2b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.301520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7882b1-d384-44fb-8d95-57c8db118f2b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:15.302162 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4c7882b1-d384-44fb-8d95-57c8db118f2b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:15.412444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4c7882b1-d384-44fb-8d95-57c8db118f2b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:15.427549 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4c7882b1-d384-44fb-8d95-57c8db118f2b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1277 microversion: 2.1 time: 0.151868 Jul 25 16:29:15.428753 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 250/463] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:15 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:15.473740 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-441cc767-22c0-4c31-99b9-1bd4a44582a8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:15.488576 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-441cc767-22c0-4c31-99b9-1bd4a44582a8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.332872 Jul 25 16:29:15.489825 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 214/464] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:15 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:16.313391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb15f9e8-fbd6-40f6-9557-2e990affff35 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:16.314541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fb15f9e8-fbd6-40f6-9557-2e990affff35 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:16.326543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb15f9e8-fbd6-40f6-9557-2e990affff35 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.327164 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb15f9e8-fbd6-40f6-9557-2e990affff35 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.328208 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb15f9e8-fbd6-40f6-9557-2e990affff35 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.328788 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb15f9e8-fbd6-40f6-9557-2e990affff35 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.463395 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ba486a55-89d6-46fa-be15-70289a0eb59d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:16.464926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ba486a55-89d6-46fa-be15-70289a0eb59d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:16.490995 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba486a55-89d6-46fa-be15-70289a0eb59d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.493151 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba486a55-89d6-46fa-be15-70289a0eb59d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.494325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba486a55-89d6-46fa-be15-70289a0eb59d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.498153 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ba486a55-89d6-46fa-be15-70289a0eb59d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.673633 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fb15f9e8-fbd6-40f6-9557-2e990affff35 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:16.688824 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fb15f9e8-fbd6-40f6-9557-2e990affff35 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1756 microversion: 2.1 time: 0.383339 Jul 25 16:29:16.689893 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 251/465] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:16 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1756 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:16.698944 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-58bc6a4c-3a51-4657-94f8-59c084752b0f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:16.700266 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-58bc6a4c-3a51-4657-94f8-59c084752b0f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:16.713822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58bc6a4c-3a51-4657-94f8-59c084752b0f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.715049 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58bc6a4c-3a51-4657-94f8-59c084752b0f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.716765 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58bc6a4c-3a51-4657-94f8-59c084752b0f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:16.717489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-58bc6a4c-3a51-4657-94f8-59c084752b0f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:16.787230 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ba486a55-89d6-46fa-be15-70289a0eb59d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:16.801484 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ba486a55-89d6-46fa-be15-70289a0eb59d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1319 microversion: 2.1 time: 0.346073 Jul 25 16:29:16.802625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 215/466] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:16 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:16.937996 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-58bc6a4c-3a51-4657-94f8-59c084752b0f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:16.950600 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-58bc6a4c-3a51-4657-94f8-59c084752b0f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.259010 Jul 25 16:29:16.951114 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 252/467] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:16 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:17.723317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-03b319a0-b209-4fd9-a9b9-2ca50cff90a7 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:17.724200 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-03b319a0-b209-4fd9-a9b9-2ca50cff90a7 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:17.731101 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03b319a0-b209-4fd9-a9b9-2ca50cff90a7 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.731542 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03b319a0-b209-4fd9-a9b9-2ca50cff90a7 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.732321 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03b319a0-b209-4fd9-a9b9-2ca50cff90a7 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.732738 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-03b319a0-b209-4fd9-a9b9-2ca50cff90a7 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.848541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3ffe58fe-7a90-4c30-acb3-0a27df4af845 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:17.854156 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3ffe58fe-7a90-4c30-acb3-0a27df4af845 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:17.870871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ffe58fe-7a90-4c30-acb3-0a27df4af845 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.871452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ffe58fe-7a90-4c30-acb3-0a27df4af845 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.872355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ffe58fe-7a90-4c30-acb3-0a27df4af845 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:17.872856 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3ffe58fe-7a90-4c30-acb3-0a27df4af845 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:17.914161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:17.977040 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-03b319a0-b209-4fd9-a9b9-2ca50cff90a7 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:17.994812 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-03b319a0-b209-4fd9-a9b9-2ca50cff90a7 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1756 microversion: 2.1 time: 0.275717 Jul 25 16:29:17.995898 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 216/468] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:17 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1756 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:18.004987 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f5771031-8dac-4d02-bafc-676424ebb2e1 req-ec5808f7-6980-4fc3-9149-da5980675d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1ec0116-debd-4943-b25b-d5862060ae0c", "tag": "a0f8c860-81a3-4e61-828b-b3a04c3c4c98"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:18.023916 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f5771031-8dac-4d02-bafc-676424ebb2e1 req-ec5808f7-6980-4fc3-9149-da5980675d88 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:18.024704 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f5771031-8dac-4d02-bafc-676424ebb2e1 req-ec5808f7-6980-4fc3-9149-da5980675d88 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:18.045738 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f5771031-8dac-4d02-bafc-676424ebb2e1 req-ec5808f7-6980-4fc3-9149-da5980675d88 service nova] Creating event network-changed:a0f8c860-81a3-4e61-828b-b3a04c3c4c98 for instance e1ec0116-debd-4943-b25b-d5862060ae0c on hv-cinder-83697 Jul 25 16:29:18.052863 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f5771031-8dac-4d02-bafc-676424ebb2e1 req-ec5808f7-6980-4fc3-9149-da5980675d88 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054691 Jul 25 16:29:18.054577 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 217/469] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:18.062628 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d25da875-85a2-4fd3-bc8e-619d698b74e7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:18.063923 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d25da875-85a2-4fd3-bc8e-619d698b74e7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:18.070819 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d25da875-85a2-4fd3-bc8e-619d698b74e7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:18.071595 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d25da875-85a2-4fd3-bc8e-619d698b74e7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:18.072903 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d25da875-85a2-4fd3-bc8e-619d698b74e7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:18.073494 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d25da875-85a2-4fd3-bc8e-619d698b74e7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:18.108961 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3ffe58fe-7a90-4c30-acb3-0a27df4af845 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:18.120033 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3ffe58fe-7a90-4c30-acb3-0a27df4af845 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1319 microversion: 2.1 time: 0.286810 Jul 25 16:29:18.120657 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 253/470] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:17 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:18.245847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d25da875-85a2-4fd3-bc8e-619d698b74e7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:18.254114 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d25da875-85a2-4fd3-bc8e-619d698b74e7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.198219 Jul 25 16:29:18.254685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 218/471] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:18 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:19.019613 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8534b2c8-754f-4fab-b8f7-3e91ab81e34e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:19.021420 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8534b2c8-754f-4fab-b8f7-3e91ab81e34e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:19.030384 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8534b2c8-754f-4fab-b8f7-3e91ab81e34e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.031119 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8534b2c8-754f-4fab-b8f7-3e91ab81e34e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.032165 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8534b2c8-754f-4fab-b8f7-3e91ab81e34e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.032687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8534b2c8-754f-4fab-b8f7-3e91ab81e34e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.157854 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1a6bb94-20f2-42bf-88fa-0dc23ae3b1e8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:19.159094 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1a6bb94-20f2-42bf-88fa-0dc23ae3b1e8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:19.166973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1a6bb94-20f2-42bf-88fa-0dc23ae3b1e8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.167415 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1a6bb94-20f2-42bf-88fa-0dc23ae3b1e8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.168232 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1a6bb94-20f2-42bf-88fa-0dc23ae3b1e8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.168660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1a6bb94-20f2-42bf-88fa-0dc23ae3b1e8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.286563 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8534b2c8-754f-4fab-b8f7-3e91ab81e34e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:19.302769 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8534b2c8-754f-4fab-b8f7-3e91ab81e34e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1759 microversion: 2.1 time: 0.286517 Jul 25 16:29:19.303871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 254/472] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:19 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1759 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:19.310440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fcd5c9ff-0bd8-475a-80ae-75845746ae29 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:19.311231 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fcd5c9ff-0bd8-475a-80ae-75845746ae29 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:19.322524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcd5c9ff-0bd8-475a-80ae-75845746ae29 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.323745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcd5c9ff-0bd8-475a-80ae-75845746ae29 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.325474 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcd5c9ff-0bd8-475a-80ae-75845746ae29 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:19.326019 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcd5c9ff-0bd8-475a-80ae-75845746ae29 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:19.450254 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c1a6bb94-20f2-42bf-88fa-0dc23ae3b1e8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:19.465678 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1a6bb94-20f2-42bf-88fa-0dc23ae3b1e8 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1319 microversion: 2.1 time: 0.314575 Jul 25 16:29:19.466762 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 219/473] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:19 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:19.527686 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fcd5c9ff-0bd8-475a-80ae-75845746ae29 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:19.539500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fcd5c9ff-0bd8-475a-80ae-75845746ae29 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.233930 Jul 25 16:29:19.540071 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 255/474] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:19 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:20.508918 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3f1e36de-851f-49c9-9c9b-577061d199dd tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:20.510045 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3f1e36de-851f-49c9-9c9b-577061d199dd tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:20.521544 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f1e36de-851f-49c9-9c9b-577061d199dd tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:20.522255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f1e36de-851f-49c9-9c9b-577061d199dd tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:20.523748 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f1e36de-851f-49c9-9c9b-577061d199dd tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:20.524524 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3f1e36de-851f-49c9-9c9b-577061d199dd tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:20.573213 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f985e613-5745-486a-98c4-fe487c38ddd1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:20.574267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f985e613-5745-486a-98c4-fe487c38ddd1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:20.585677 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f985e613-5745-486a-98c4-fe487c38ddd1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:20.586563 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f985e613-5745-486a-98c4-fe487c38ddd1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:20.587632 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f985e613-5745-486a-98c4-fe487c38ddd1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:20.588408 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f985e613-5745-486a-98c4-fe487c38ddd1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:20.859546 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3f1e36de-851f-49c9-9c9b-577061d199dd tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:20.873361 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3f1e36de-851f-49c9-9c9b-577061d199dd tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1319 microversion: 2.1 time: 0.372468 Jul 25 16:29:20.874527 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f985e613-5745-486a-98c4-fe487c38ddd1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:20.874665 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 220/475] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:20 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:20.887388 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f985e613-5745-486a-98c4-fe487c38ddd1 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.321739 Jul 25 16:29:20.888046 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 256/476] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:20 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:21.900219 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-935a8a2e-2312-4ec9-a925-4f7c8d4388fb tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:21.901090 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-935a8a2e-2312-4ec9-a925-4f7c8d4388fb tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:21.909078 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-935a8a2e-2312-4ec9-a925-4f7c8d4388fb tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.909560 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-935a8a2e-2312-4ec9-a925-4f7c8d4388fb tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.910356 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-935a8a2e-2312-4ec9-a925-4f7c8d4388fb tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.910788 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-935a8a2e-2312-4ec9-a925-4f7c8d4388fb tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.926313 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-794d8faf-688a-4227-9587-5523d094c4c7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:21.927315 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-794d8faf-688a-4227-9587-5523d094c4c7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:21.939755 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-794d8faf-688a-4227-9587-5523d094c4c7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.940575 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-794d8faf-688a-4227-9587-5523d094c4c7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:21.942194 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-794d8faf-688a-4227-9587-5523d094c4c7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:21.942877 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-794d8faf-688a-4227-9587-5523d094c4c7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:22.185784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-935a8a2e-2312-4ec9-a925-4f7c8d4388fb tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:22.195598 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-935a8a2e-2312-4ec9-a925-4f7c8d4388fb tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1319 microversion: 2.1 time: 0.300407 Jul 25 16:29:22.196298 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 221/477] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:21 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:22.230861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-794d8faf-688a-4227-9587-5523d094c4c7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:22.240327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-794d8faf-688a-4227-9587-5523d094c4c7 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.321194 Jul 25 16:29:22.241567 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 257/478] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:21 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:23.227772 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5206d30-a61c-430f-a1f6-614fc46c8db0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:23.228959 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5206d30-a61c-430f-a1f6-614fc46c8db0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:23.232835 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=4 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:23.245471 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5206d30-a61c-430f-a1f6-614fc46c8db0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.246288 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5206d30-a61c-430f-a1f6-614fc46c8db0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.248096 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5206d30-a61c-430f-a1f6-614fc46c8db0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.248705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5206d30-a61c-430f-a1f6-614fc46c8db0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.279051 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-22b2f68e-411a-472f-a419-abd883cbc1b8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:23.280199 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-22b2f68e-411a-472f-a419-abd883cbc1b8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:23.285857 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:23.287116 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=12 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:23.296082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22b2f68e-411a-472f-a419-abd883cbc1b8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.297370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22b2f68e-411a-472f-a419-abd883cbc1b8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.298744 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22b2f68e-411a-472f-a419-abd883cbc1b8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:23.299230 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-22b2f68e-411a-472f-a419-abd883cbc1b8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:23.455187 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e5206d30-a61c-430f-a1f6-614fc46c8db0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:23.472303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5206d30-a61c-430f-a1f6-614fc46c8db0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1319 microversion: 2.1 time: 0.250770 Jul 25 16:29:23.472303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 222/479] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:23 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:23.667672 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-22b2f68e-411a-472f-a419-abd883cbc1b8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:23.682248 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-22b2f68e-411a-472f-a419-abd883cbc1b8 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.410322 Jul 25 16:29:23.683320 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 258/480] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:23 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:24.506130 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-83dcf229-d0b5-44b1-976f-d1cd7974b61d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:24.506960 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-83dcf229-d0b5-44b1-976f-d1cd7974b61d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:24.513935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83dcf229-d0b5-44b1-976f-d1cd7974b61d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:24.514412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83dcf229-d0b5-44b1-976f-d1cd7974b61d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:24.515284 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83dcf229-d0b5-44b1-976f-d1cd7974b61d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:24.515877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-83dcf229-d0b5-44b1-976f-d1cd7974b61d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:24.672260 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-83dcf229-d0b5-44b1-976f-d1cd7974b61d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:24.681063 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-83dcf229-d0b5-44b1-976f-d1cd7974b61d tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1319 microversion: 2.1 time: 0.179003 Jul 25 16:29:24.681954 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 223/481] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:24 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:24.713152 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b5e59fa7-0d7d-4f29-b772-7a2fd640e2b4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:24.714283 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b5e59fa7-0d7d-4f29-b772-7a2fd640e2b4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:24.722705 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5e59fa7-0d7d-4f29-b772-7a2fd640e2b4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:24.723153 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5e59fa7-0d7d-4f29-b772-7a2fd640e2b4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:24.724281 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5e59fa7-0d7d-4f29-b772-7a2fd640e2b4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:24.724749 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b5e59fa7-0d7d-4f29-b772-7a2fd640e2b4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:24.904275 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b5e59fa7-0d7d-4f29-b772-7a2fd640e2b4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:24.918324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b5e59fa7-0d7d-4f29-b772-7a2fd640e2b4 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.212207 Jul 25 16:29:24.919563 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 259/482] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:24 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:25.278565 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-d739f534-68a0-42a0-bda8-a47ba4b1238f req-3f152cb4-709e-497d-bf33-a162dce7db09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ec0116-debd-4943-b25b-d5862060ae0c", "name": "network-vif-plugged", "status": "completed", "tag": "a0f8c860-81a3-4e61-828b-b3a04c3c4c98"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:25.299301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d739f534-68a0-42a0-bda8-a47ba4b1238f req-3f152cb4-709e-497d-bf33-a162dce7db09 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:25.300031 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-d739f534-68a0-42a0-bda8-a47ba4b1238f req-3f152cb4-709e-497d-bf33-a162dce7db09 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:25.327517 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-d739f534-68a0-42a0-bda8-a47ba4b1238f req-3f152cb4-709e-497d-bf33-a162dce7db09 service nova] Creating event network-vif-plugged:a0f8c860-81a3-4e61-828b-b3a04c3c4c98 for instance e1ec0116-debd-4943-b25b-d5862060ae0c on hv-cinder-83697 Jul 25 16:29:25.334803 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-d739f534-68a0-42a0-bda8-a47ba4b1238f req-3f152cb4-709e-497d-bf33-a162dce7db09 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064589 Jul 25 16:29:25.335644 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 224/483] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:25.704480 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-45760819-cddc-4153-b8d0-a6340ac6c43a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:25.705126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-45760819-cddc-4153-b8d0-a6340ac6c43a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:25.714414 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45760819-cddc-4153-b8d0-a6340ac6c43a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:25.715436 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45760819-cddc-4153-b8d0-a6340ac6c43a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:25.715965 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45760819-cddc-4153-b8d0-a6340ac6c43a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:25.716628 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-45760819-cddc-4153-b8d0-a6340ac6c43a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:25.931901 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-45760819-cddc-4153-b8d0-a6340ac6c43a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:25.941697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-45760819-cddc-4153-b8d0-a6340ac6c43a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1319 microversion: 2.1 time: 0.241230 Jul 25 16:29:25.942169 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 260/484] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:25 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:25.950836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c6e1fc46-90ec-4751-83d3-98d9a19b184e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:25.952309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c6e1fc46-90ec-4751-83d3-98d9a19b184e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:25.960909 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6e1fc46-90ec-4751-83d3-98d9a19b184e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:25.961403 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6e1fc46-90ec-4751-83d3-98d9a19b184e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:25.962211 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6e1fc46-90ec-4751-83d3-98d9a19b184e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:25.962638 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c6e1fc46-90ec-4751-83d3-98d9a19b184e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.199449 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c6e1fc46-90ec-4751-83d3-98d9a19b184e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:26.214487 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c6e1fc46-90ec-4751-83d3-98d9a19b184e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.271186 Jul 25 16:29:26.215480 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 225/485] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:25 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:26.732660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-42c5f73a-27a6-49d6-8fc8-752e7d483844 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:26.736127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-42c5f73a-27a6-49d6-8fc8-752e7d483844 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:26.749387 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-42c5f73a-27a6-49d6-8fc8-752e7d483844 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.750220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-42c5f73a-27a6-49d6-8fc8-752e7d483844 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.751668 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-42c5f73a-27a6-49d6-8fc8-752e7d483844 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.752457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-42c5f73a-27a6-49d6-8fc8-752e7d483844 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.813314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-42c5f73a-27a6-49d6-8fc8-752e7d483844 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087057 Jul 25 16:29:26.814523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 261/486] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:29:26 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:29:26.904865 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02c51f3f-3519-41d9-986d-b54b8aa279d7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:26.905799 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02c51f3f-3519-41d9-986d-b54b8aa279d7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:26.909568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=62 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:26.920018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02c51f3f-3519-41d9-986d-b54b8aa279d7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.920806 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02c51f3f-3519-41d9-986d-b54b8aa279d7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.922122 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02c51f3f-3519-41d9-986d-b54b8aa279d7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.922566 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02c51f3f-3519-41d9-986d-b54b8aa279d7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.956488 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02c51f3f-3519-41d9-986d-b54b8aa279d7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:26.966132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-41c7fcf1-1658-4efa-82cd-a733c03532fe tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:26.967007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-41c7fcf1-1658-4efa-82cd-a733c03532fe tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:26.975523 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=100 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:26.976171 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41c7fcf1-1658-4efa-82cd-a733c03532fe tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.976969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41c7fcf1-1658-4efa-82cd-a733c03532fe tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:26.978729 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41c7fcf1-1658-4efa-82cd-a733c03532fe tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:26.979793 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-41c7fcf1-1658-4efa-82cd-a733c03532fe tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:27.079421 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02c51f3f-3519-41d9-986d-b54b8aa279d7 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 204 len: 0 microversion: 2.1 time: 0.181439 Jul 25 16:29:27.080718 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 226/487] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:29:26 2022] DELETE /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:27.096223 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ca8ea3bd-8a09-4696-bbdf-0485340904a3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:27.097616 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ca8ea3bd-8a09-4696-bbdf-0485340904a3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:27.110004 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca8ea3bd-8a09-4696-bbdf-0485340904a3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:27.110781 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca8ea3bd-8a09-4696-bbdf-0485340904a3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:27.112894 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca8ea3bd-8a09-4696-bbdf-0485340904a3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:27.113462 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ca8ea3bd-8a09-4696-bbdf-0485340904a3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:27.243183 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-41c7fcf1-1658-4efa-82cd-a733c03532fe tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:27.257931 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-41c7fcf1-1658-4efa-82cd-a733c03532fe tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1319 microversion: 2.1 time: 0.296345 Jul 25 16:29:27.258998 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 262/488] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:26 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:27.268150 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fcc346cf-6c7b-431e-979c-f0157901a114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:27.269741 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fcc346cf-6c7b-431e-979c-f0157901a114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:27.302339 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcc346cf-6c7b-431e-979c-f0157901a114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:27.303510 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcc346cf-6c7b-431e-979c-f0157901a114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:27.305551 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcc346cf-6c7b-431e-979c-f0157901a114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:27.315323 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fcc346cf-6c7b-431e-979c-f0157901a114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:27.472222 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ca8ea3bd-8a09-4696-bbdf-0485340904a3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:27.482025 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ca8ea3bd-8a09-4696-bbdf-0485340904a3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1673 microversion: 2.1 time: 0.393753 Jul 25 16:29:27.482639 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 227/489] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:27 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1673 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:27.488764 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-71cdf9a3-5fdc-4ad1-8a2a-02d497408891 req-cd1bf677-1e42-430f-bfbb-430836c3b3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb", "name": "network-vif-plugged", "status": "completed", "tag": "54cf1201-fdc0-44ce-bc59-698ade1f2c99"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:27.500516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-71cdf9a3-5fdc-4ad1-8a2a-02d497408891 req-cd1bf677-1e42-430f-bfbb-430836c3b3ac service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:27.500924 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-71cdf9a3-5fdc-4ad1-8a2a-02d497408891 req-cd1bf677-1e42-430f-bfbb-430836c3b3ac service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:27.516466 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-71cdf9a3-5fdc-4ad1-8a2a-02d497408891 req-cd1bf677-1e42-430f-bfbb-430836c3b3ac service nova] Creating event network-vif-plugged:54cf1201-fdc0-44ce-bc59-698ade1f2c99 for instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb on hv-cinder-83697 Jul 25 16:29:27.522489 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-71cdf9a3-5fdc-4ad1-8a2a-02d497408891 req-cd1bf677-1e42-430f-bfbb-430836c3b3ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038386 Jul 25 16:29:27.523575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 228/490] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:27.580420 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fcc346cf-6c7b-431e-979c-f0157901a114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:27.590404 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fcc346cf-6c7b-431e-979c-f0157901a114 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.329498 Jul 25 16:29:27.591228 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 263/491] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:27 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:28.306089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5938a56e-e388-48df-8cee-3dfc3118c09c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:28.307366 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5938a56e-e388-48df-8cee-3dfc3118c09c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:28.319411 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5938a56e-e388-48df-8cee-3dfc3118c09c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.320201 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5938a56e-e388-48df-8cee-3dfc3118c09c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.321641 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5938a56e-e388-48df-8cee-3dfc3118c09c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.322417 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5938a56e-e388-48df-8cee-3dfc3118c09c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.515098 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-546752db-5a00-4502-818b-5cf8fab711e0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:28.516025 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-546752db-5a00-4502-818b-5cf8fab711e0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:28.524352 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-546752db-5a00-4502-818b-5cf8fab711e0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.525140 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-546752db-5a00-4502-818b-5cf8fab711e0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.526650 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-546752db-5a00-4502-818b-5cf8fab711e0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.527430 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-546752db-5a00-4502-818b-5cf8fab711e0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.535146 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5938a56e-e388-48df-8cee-3dfc3118c09c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:28.550197 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5938a56e-e388-48df-8cee-3dfc3118c09c tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1507 microversion: 2.1 time: 0.252717 Jul 25 16:29:28.551160 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 229/492] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:28 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:28.579167 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-30194862-0811-4d2a-844e-80e9be4ba6c0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77fe5451-68a5-47db-ba45-a970ac382014", "device": "/dev/sdb"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:28.584707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-30194862-0811-4d2a-844e-80e9be4ba6c0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:28.596892 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30194862-0811-4d2a-844e-80e9be4ba6c0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.597714 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30194862-0811-4d2a-844e-80e9be4ba6c0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.599123 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30194862-0811-4d2a-844e-80e9be4ba6c0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.599900 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30194862-0811-4d2a-844e-80e9be4ba6c0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.721810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-546752db-5a00-4502-818b-5cf8fab711e0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:28.733126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-546752db-5a00-4502-818b-5cf8fab711e0 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1673 microversion: 2.1 time: 0.224635 Jul 25 16:29:28.734152 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 264/493] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:28 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1673 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:28.747021 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-34a32cc0-3c15-4dec-ba7e-8e3ba685ccb9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:28.747021 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-34a32cc0-3c15-4dec-ba7e-8e3ba685ccb9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:28.753356 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34a32cc0-3c15-4dec-ba7e-8e3ba685ccb9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.754127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34a32cc0-3c15-4dec-ba7e-8e3ba685ccb9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.755575 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34a32cc0-3c15-4dec-ba7e-8e3ba685ccb9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:28.756070 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-34a32cc0-3c15-4dec-ba7e-8e3ba685ccb9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:28.965365 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-34a32cc0-3c15-4dec-ba7e-8e3ba685ccb9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:28.973721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-34a32cc0-3c15-4dec-ba7e-8e3ba685ccb9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.238046 Jul 25 16:29:28.974318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 265/494] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:28 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:29.572256 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-30194862-0811-4d2a-844e-80e9be4ba6c0 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "POST /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.999876 Jul 25 16:29:29.573308 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 230/495] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:29:28 2022] POST /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c/os-volume_attachments => generated 194 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:29.756745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0b9a604c-4a47-4561-9a5c-34f98b6906d4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:29.757501 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0b9a604c-4a47-4561-9a5c-34f98b6906d4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:29.764735 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b9a604c-4a47-4561-9a5c-34f98b6906d4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:29.765187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b9a604c-4a47-4561-9a5c-34f98b6906d4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:29.766011 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b9a604c-4a47-4561-9a5c-34f98b6906d4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:29.766456 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b9a604c-4a47-4561-9a5c-34f98b6906d4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:30.009513 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0b9a604c-4a47-4561-9a5c-34f98b6906d4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:30.011117 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d71cc442-8c4d-44ff-844c-504d90dd348f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:30.012326 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d71cc442-8c4d-44ff-844c-504d90dd348f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:30.023616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0b9a604c-4a47-4561-9a5c-34f98b6906d4 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1673 microversion: 2.1 time: 0.270799 Jul 25 16:29:30.025547 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 266/496] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:29 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1673 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:30.034575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d71cc442-8c4d-44ff-844c-504d90dd348f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:30.035340 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d71cc442-8c4d-44ff-844c-504d90dd348f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:30.038899 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d71cc442-8c4d-44ff-844c-504d90dd348f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:30.039539 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d71cc442-8c4d-44ff-844c-504d90dd348f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:30.230419 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d71cc442-8c4d-44ff-844c-504d90dd348f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:30.243357 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d71cc442-8c4d-44ff-844c-504d90dd348f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.240649 Jul 25 16:29:30.244739 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 231/497] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:30 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:31.064052 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c15044ff-7793-46a8-a7bd-144b9fcaa94e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:31.065149 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c15044ff-7793-46a8-a7bd-144b9fcaa94e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:31.075678 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c15044ff-7793-46a8-a7bd-144b9fcaa94e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.076259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c15044ff-7793-46a8-a7bd-144b9fcaa94e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.078333 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c15044ff-7793-46a8-a7bd-144b9fcaa94e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.078526 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c15044ff-7793-46a8-a7bd-144b9fcaa94e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.169606 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-b4e9a23e-2c8d-44aa-a433-52ad6950490f req-dcc88731-1021-4ff7-b407-172d3a4e834a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfffb541-3a46-4a3f-ad6c-8d7a88586b23", "name": "network-vif-deleted", "tag": "aaea7be2-6388-4c1f-8fe7-40d03b69cf00"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:31.187643 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c15044ff-7793-46a8-a7bd-144b9fcaa94e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:31.190530 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4e9a23e-2c8d-44aa-a433-52ad6950490f req-dcc88731-1021-4ff7-b407-172d3a4e834a service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.192660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-b4e9a23e-2c8d-44aa-a433-52ad6950490f req-dcc88731-1021-4ff7-b407-172d3a4e834a service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.197798 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c15044ff-7793-46a8-a7bd-144b9fcaa94e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 200 len: 1605 microversion: 2.1 time: 0.140862 Jul 25 16:29:31.206251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 267/498] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:31 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 1605 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:31.213744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-b4e9a23e-2c8d-44aa-a433-52ad6950490f req-dcc88731-1021-4ff7-b407-172d3a4e834a service nova] Creating event network-vif-deleted:aaea7be2-6388-4c1f-8fe7-40d03b69cf00 for instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 on hv-cinder-83697 Jul 25 16:29:31.220208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-b4e9a23e-2c8d-44aa-a433-52ad6950490f req-dcc88731-1021-4ff7-b407-172d3a4e834a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057693 Jul 25 16:29:31.222440 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 232/499] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:31.279489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-125fb165-d3b3-46d1-9a09-88a5a0abaddf tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:31.280935 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-125fb165-d3b3-46d1-9a09-88a5a0abaddf tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:31.294231 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-125fb165-d3b3-46d1-9a09-88a5a0abaddf tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.295530 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-125fb165-d3b3-46d1-9a09-88a5a0abaddf tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.297523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-125fb165-d3b3-46d1-9a09-88a5a0abaddf tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:31.298756 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-125fb165-d3b3-46d1-9a09-88a5a0abaddf tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:31.498191 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-125fb165-d3b3-46d1-9a09-88a5a0abaddf tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:31.507804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-125fb165-d3b3-46d1-9a09-88a5a0abaddf tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1261 microversion: 2.1 time: 0.234127 Jul 25 16:29:31.508849 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 268/500] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:31 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:32.223412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:32.224763 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:32.233294 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:32.234160 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:32.235217 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:32.235832 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:32.260688 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] HTTP exception thrown: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Request method failure captured: Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 HTTP/1.1 Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sPGSryRSVQAbbL4_p3DSgGFH0zVMx8Yy-OgvSZsanbr2j6TB9EMmO3KM5oh9iG4CVueXCaEoHiYLuH8rCoVHTOr2fAQ4gOMdLAAGxAAaptEkpMbLjyy2jumiwnoVEZess8TI64M2reIRuKRE8C6xkoOBB_b5_L2Fg9D_rNbPXi6cdA Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:29:32.263968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c4be8083168475198c66cca890b18a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c4be8083168475198c66cca890b18a9"}]}] Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 644c0a532fa747c7abf4d53759e89181 Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:29:32.266847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'bfffb541-3a46-4a3f-ad6c-8d7a88586b23'} Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:32.268425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:29:32.271303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:29:32.273748 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Returning 404 to user: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:32.273748 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fa4b0eb7-eed2-496b-8e52-25d89769e6db tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 404 len: 111 microversion: 2.1 time: 0.049416 Jul 25 16:29:32.273748 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 233/501] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:32 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:29:32.281993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5392f754-190a-41c3-8d49-660a992a01a2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '.version_select at 0x7f440a776d30>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:32.320437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5392f754-190a-41c3-8d49-660a992a01a2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579592235" status: 202 len: 0 microversion: 2.1 time: 0.044640 Jul 25 16:29:32.322219 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 269/502] 10.222.0.66 () {58 vars in 1218 bytes} [Mon Jul 25 16:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579592235 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:29:32.541313 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b55c9a57-edb7-4180-ac31-9a33a5ad69cb tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:32.543446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b55c9a57-edb7-4180-ac31-9a33a5ad69cb tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:32.557109 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b55c9a57-edb7-4180-ac31-9a33a5ad69cb tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:32.558631 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b55c9a57-edb7-4180-ac31-9a33a5ad69cb tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:32.561134 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b55c9a57-edb7-4180-ac31-9a33a5ad69cb tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:32.562249 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b55c9a57-edb7-4180-ac31-9a33a5ad69cb tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:33.113277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b55c9a57-edb7-4180-ac31-9a33a5ad69cb tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:33.126181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b55c9a57-edb7-4180-ac31-9a33a5ad69cb tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1445 microversion: 2.1 time: 0.594751 Jul 25 16:29:33.140167 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 234/503] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:32 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1445 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:33.156888 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e8cd999e-2f56-4e3c-9fb1-21255413c50a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:33.157647 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e8cd999e-2f56-4e3c-9fb1-21255413c50a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:33.165893 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cd999e-2f56-4e3c-9fb1-21255413c50a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:33.166473 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cd999e-2f56-4e3c-9fb1-21255413c50a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:33.167390 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cd999e-2f56-4e3c-9fb1-21255413c50a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:33.167924 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e8cd999e-2f56-4e3c-9fb1-21255413c50a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:33.494128 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e8cd999e-2f56-4e3c-9fb1-21255413c50a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:33.508907 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e8cd999e-2f56-4e3c-9fb1-21255413c50a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1445 microversion: 2.1 time: 0.356203 Jul 25 16:29:33.509933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 270/504] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:33 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1445 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:33.776476 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-020b2ccf-a265-4e11-9d25-bffc967d6191 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'create', calling method: .version_select at 0x7f4410177c10>, body: {"keypair": {"name": "tempest-keypair-1902897875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC23ZkxXuiFTJgDKJ2BwmdwmMuoGakgIsmqU0BZesHTjoDEEAIp9H5KkSnzP3mB7Nysn0giPD5Uk2Db5nSWbytZPzK75/IxzWlhJRRLwlUB8ImZd5Z8akQBnlZ2yc9I6hQ=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:33.806900 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-020b2ccf-a265-4e11-9d25-bffc967d6191 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Getting quotas for project 5c4be8083168475198c66cca890b18a9. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:29:33.815242 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-020b2ccf-a265-4e11-9d25-bffc967d6191 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Getting quotas for user 644c0a532fa747c7abf4d53759e89181 and project 5c4be8083168475198c66cca890b18a9. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:29:33.856536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-020b2ccf-a265-4e11-9d25-bffc967d6191 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087991 Jul 25 16:29:33.857693 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 235/505] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:29:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:37.004349 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1735244975", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab360f41-bf62-4a29-ad06-3a6595fd95fd"}], "security_groups": [{"name": "tempest-securitygroup--188786032"}], "key_name": "tempest-keypair-1902897875", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:37.044063 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-86fe6c13-d7e7-45a0-8c00-36172d595422 req-39e78e40-9d0d-49da-8a93-813b093b85d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb", "tag": "54cf1201-fdc0-44ce-bc59-698ade1f2c99"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:37.068164 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-86fe6c13-d7e7-45a0-8c00-36172d595422 req-39e78e40-9d0d-49da-8a93-813b093b85d8 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:37.069589 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-86fe6c13-d7e7-45a0-8c00-36172d595422 req-39e78e40-9d0d-49da-8a93-813b093b85d8 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:37.087996 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-86fe6c13-d7e7-45a0-8c00-36172d595422 req-39e78e40-9d0d-49da-8a93-813b093b85d8 service nova] Creating event network-changed:54cf1201-fdc0-44ce-bc59-698ade1f2c99 for instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb on hv-cinder-83697 Jul 25 16:29:37.096547 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-86fe6c13-d7e7-45a0-8c00-36172d595422 req-39e78e40-9d0d-49da-8a93-813b093b85d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065327 Jul 25 16:29:37.097411 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 236/506] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:37.192933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] validate_networks() for [('ab360f41-bf62-4a29-ad06-3a6595fd95fd', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:29:38.296080 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:29:38.297861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:29:38.298402 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:29:38.299341 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:29:38.300177 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:29:38.313864 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:38.314308 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:38.315675 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:38.316399 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:38.326635 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:38.344286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Getting quotas for project 5c4be8083168475198c66cca890b18a9. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:29:38.352268 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Getting quotas for user 644c0a532fa747c7abf4d53759e89181 and project 5c4be8083168475198c66cca890b18a9. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:29:38.372907 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:29:38.376615 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:29:38.395758 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:38.463051 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d630c428-185a-46f0-8521-ba934b554a90 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.466457 Jul 25 16:29:38.464574 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 271/507] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:29:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1469 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 16:29:38.483239 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf3f8bb8-83e3-4308-8c23-90165e0d4603 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:38.484501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf3f8bb8-83e3-4308-8c23-90165e0d4603 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:38.587133 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cf3f8bb8-83e3-4308-8c23-90165e0d4603 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:38.595437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf3f8bb8-83e3-4308-8c23-90165e0d4603 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1238 microversion: 2.1 time: 0.121681 Jul 25 16:29:38.596041 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 237/508] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:38 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1238 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:39.174240 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb3b49ee-9bf8-4faf-98d0-52ff8e250727 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:39.175358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fb3b49ee-9bf8-4faf-98d0-52ff8e250727 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:39.188116 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb3b49ee-9bf8-4faf-98d0-52ff8e250727 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:39.188844 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb3b49ee-9bf8-4faf-98d0-52ff8e250727 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:39.190127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb3b49ee-9bf8-4faf-98d0-52ff8e250727 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:39.190797 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb3b49ee-9bf8-4faf-98d0-52ff8e250727 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:39.305927 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-fb3b49ee-9bf8-4faf-98d0-52ff8e250727 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lazy-loading 'services' on Instance uuid 931c107b-f645-476f-9b81-2dab0fedf218 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:39.404250 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fb3b49ee-9bf8-4faf-98d0-52ff8e250727 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "DELETE /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments/d04e95cf-f570-43ce-b518-84c752ca5335" status: 202 len: 0 microversion: 2.1 time: 0.237657 Jul 25 16:29:39.404911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 272/509] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:29:39 2022] DELETE /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments/d04e95cf-f570-43ce-b518-84c752ca5335 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:29:39.415689 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3c6583f3-32a5-427b-acd3-ba568b14bc18 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:39.417897 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3c6583f3-32a5-427b-acd3-ba568b14bc18 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:39.425818 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c6583f3-32a5-427b-acd3-ba568b14bc18 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:39.426247 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c6583f3-32a5-427b-acd3-ba568b14bc18 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:39.427137 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c6583f3-32a5-427b-acd3-ba568b14bc18 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:39.427569 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3c6583f3-32a5-427b-acd3-ba568b14bc18 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:39.466857 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3c6583f3-32a5-427b-acd3-ba568b14bc18 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055612 Jul 25 16:29:39.469801 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 238/510] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:29:39 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:39.690326 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cbba5bcf-fdb6-4177-99ff-b3c3bdf33a36 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:39.691113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cbba5bcf-fdb6-4177-99ff-b3c3bdf33a36 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:39.699682 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbba5bcf-fdb6-4177-99ff-b3c3bdf33a36 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:39.700362 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbba5bcf-fdb6-4177-99ff-b3c3bdf33a36 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:39.701619 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbba5bcf-fdb6-4177-99ff-b3c3bdf33a36 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:39.702328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cbba5bcf-fdb6-4177-99ff-b3c3bdf33a36 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:39.777035 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cbba5bcf-fdb6-4177-99ff-b3c3bdf33a36 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:39.788144 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cbba5bcf-fdb6-4177-99ff-b3c3bdf33a36 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1242 microversion: 2.1 time: 0.172592 Jul 25 16:29:39.801373 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 273/511] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:39 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1242 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:40.487428 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d1a0abc0-e7b6-4d27-b334-ef336c0222f3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:40.490030 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d1a0abc0-e7b6-4d27-b334-ef336c0222f3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:40.497385 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1a0abc0-e7b6-4d27-b334-ef336c0222f3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.497867 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1a0abc0-e7b6-4d27-b334-ef336c0222f3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.498684 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1a0abc0-e7b6-4d27-b334-ef336c0222f3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.499132 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d1a0abc0-e7b6-4d27-b334-ef336c0222f3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.534310 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d1a0abc0-e7b6-4d27-b334-ef336c0222f3 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050869 Jul 25 16:29:40.534929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 239/512] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:29:40 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:40.829959 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-be673c9d-a917-4ec3-8777-fe404357430a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:40.832699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-be673c9d-a917-4ec3-8777-fe404357430a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:40.847201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be673c9d-a917-4ec3-8777-fe404357430a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.848306 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be673c9d-a917-4ec3-8777-fe404357430a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.849489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be673c9d-a917-4ec3-8777-fe404357430a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:40.849931 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-be673c9d-a917-4ec3-8777-fe404357430a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:40.953237 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-be673c9d-a917-4ec3-8777-fe404357430a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:40.964981 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-be673c9d-a917-4ec3-8777-fe404357430a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1242 microversion: 2.1 time: 0.142790 Jul 25 16:29:40.965774 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 274/513] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:40 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1242 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:41.547661 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-72535277-f014-4252-b100-818f022f0819 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:41.550531 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-72535277-f014-4252-b100-818f022f0819 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:41.559168 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72535277-f014-4252-b100-818f022f0819 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:41.559715 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72535277-f014-4252-b100-818f022f0819 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:41.560635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72535277-f014-4252-b100-818f022f0819 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:41.561192 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-72535277-f014-4252-b100-818f022f0819 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:41.596775 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-72535277-f014-4252-b100-818f022f0819 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053512 Jul 25 16:29:41.597391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 240/514] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:29:41 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:41.996740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4541db5-e55f-4b7b-a17f-85c2c4f00f80 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:41.999145 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4541db5-e55f-4b7b-a17f-85c2c4f00f80 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:42.014095 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4541db5-e55f-4b7b-a17f-85c2c4f00f80 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.015550 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4541db5-e55f-4b7b-a17f-85c2c4f00f80 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.019105 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4541db5-e55f-4b7b-a17f-85c2c4f00f80 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.020124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4541db5-e55f-4b7b-a17f-85c2c4f00f80 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.140176 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4541db5-e55f-4b7b-a17f-85c2c4f00f80 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:42.150697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4541db5-e55f-4b7b-a17f-85c2c4f00f80 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1296 microversion: 2.1 time: 0.163571 Jul 25 16:29:42.151427 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 275/515] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:41 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1296 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:42.610673 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-526b6e4d-1ed3-47e4-b5cc-ffe5f4685545 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:42.613783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-526b6e4d-1ed3-47e4-b5cc-ffe5f4685545 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:42.621655 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-526b6e4d-1ed3-47e4-b5cc-ffe5f4685545 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.622116 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-526b6e4d-1ed3-47e4-b5cc-ffe5f4685545 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.622932 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-526b6e4d-1ed3-47e4-b5cc-ffe5f4685545 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.623387 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-526b6e4d-1ed3-47e4-b5cc-ffe5f4685545 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.676592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-526b6e4d-1ed3-47e4-b5cc-ffe5f4685545 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070657 Jul 25 16:29:42.677755 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 241/516] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:29:42 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 16:29:42.794280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9ee4e10b-bbb9-4ce5-bc39-ac4cba2eb5f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:42.795161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9ee4e10b-bbb9-4ce5-bc39-ac4cba2eb5f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:42.807180 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9ee4e10b-bbb9-4ce5-bc39-ac4cba2eb5f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.808067 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9ee4e10b-bbb9-4ce5-bc39-ac4cba2eb5f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.809627 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9ee4e10b-bbb9-4ce5-bc39-ac4cba2eb5f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:42.810475 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9ee4e10b-bbb9-4ce5-bc39-ac4cba2eb5f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:42.863778 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9ee4e10b-bbb9-4ce5-bc39-ac4cba2eb5f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:43.005795 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9ee4e10b-bbb9-4ce5-bc39-ac4cba2eb5f1 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "DELETE /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 204 len: 0 microversion: 2.1 time: 0.218071 Jul 25 16:29:43.006860 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 276/517] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:29:42 2022] DELETE /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:43.019572 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-446249da-e377-4d0a-9810-a13569a44fb0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:43.020409 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-446249da-e377-4d0a-9810-a13569a44fb0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:43.030012 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446249da-e377-4d0a-9810-a13569a44fb0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.030490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446249da-e377-4d0a-9810-a13569a44fb0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.031735 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446249da-e377-4d0a-9810-a13569a44fb0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.032177 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-446249da-e377-4d0a-9810-a13569a44fb0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.188087 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1ab6c7b4-1855-4409-aef0-6589aaf3750f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:43.189480 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1ab6c7b4-1855-4409-aef0-6589aaf3750f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:43.203438 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ab6c7b4-1855-4409-aef0-6589aaf3750f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.204283 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ab6c7b4-1855-4409-aef0-6589aaf3750f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.206099 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ab6c7b4-1855-4409-aef0-6589aaf3750f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:43.207242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1ab6c7b4-1855-4409-aef0-6589aaf3750f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:43.313247 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-446249da-e377-4d0a-9810-a13569a44fb0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:43.328855 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-446249da-e377-4d0a-9810-a13569a44fb0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1691 microversion: 2.1 time: 0.315080 Jul 25 16:29:43.330156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 242/518] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:43 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1691 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:43.396331 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1ab6c7b4-1855-4409-aef0-6589aaf3750f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:43.405717 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1ab6c7b4-1855-4409-aef0-6589aaf3750f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.224975 Jul 25 16:29:43.406372 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 277/519] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:43 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:44.368247 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9e9ff809-1063-43d8-8924-fd8c3a159a87 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:44.369448 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9e9ff809-1063-43d8-8924-fd8c3a159a87 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:44.381664 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e9ff809-1063-43d8-8924-fd8c3a159a87 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:44.382445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e9ff809-1063-43d8-8924-fd8c3a159a87 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:44.383820 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e9ff809-1063-43d8-8924-fd8c3a159a87 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:44.384597 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e9ff809-1063-43d8-8924-fd8c3a159a87 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:44.440100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a0f61f31-074a-4c94-896c-b8e33a5f0270 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:44.440688 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a0f61f31-074a-4c94-896c-b8e33a5f0270 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:44.450266 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0f61f31-074a-4c94-896c-b8e33a5f0270 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:44.451042 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0f61f31-074a-4c94-896c-b8e33a5f0270 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:44.452489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0f61f31-074a-4c94-896c-b8e33a5f0270 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:44.453277 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a0f61f31-074a-4c94-896c-b8e33a5f0270 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:44.603888 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9e9ff809-1063-43d8-8924-fd8c3a159a87 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:44.612330 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9e9ff809-1063-43d8-8924-fd8c3a159a87 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1691 microversion: 2.1 time: 0.251540 Jul 25 16:29:44.613376 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 243/520] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:44 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1691 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:44.681117 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a0f61f31-074a-4c94-896c-b8e33a5f0270 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:44.690538 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a0f61f31-074a-4c94-896c-b8e33a5f0270 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.255238 Jul 25 16:29:44.691181 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 278/521] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:44 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:45.639309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-13f87ea1-7b53-4f4e-94e9-6c4222acb594 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:45.641007 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-13f87ea1-7b53-4f4e-94e9-6c4222acb594 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:45.649713 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13f87ea1-7b53-4f4e-94e9-6c4222acb594 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.650437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13f87ea1-7b53-4f4e-94e9-6c4222acb594 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.651501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13f87ea1-7b53-4f4e-94e9-6c4222acb594 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.652077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-13f87ea1-7b53-4f4e-94e9-6c4222acb594 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.729159 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-70a42145-6484-4040-850c-dddab56af30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:45.730342 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-70a42145-6484-4040-850c-dddab56af30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:45.744812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70a42145-6484-4040-850c-dddab56af30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.744812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70a42145-6484-4040-850c-dddab56af30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.745938 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70a42145-6484-4040-850c-dddab56af30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:45.746700 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-70a42145-6484-4040-850c-dddab56af30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:45.932414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-13f87ea1-7b53-4f4e-94e9-6c4222acb594 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:45.941245 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-13f87ea1-7b53-4f4e-94e9-6c4222acb594 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1691 microversion: 2.1 time: 0.310029 Jul 25 16:29:45.942160 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 244/522] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:45 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1691 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:46.008273 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-70a42145-6484-4040-850c-dddab56af30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:46.017360 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-70a42145-6484-4040-850c-dddab56af30a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.295600 Jul 25 16:29:46.017640 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 279/523] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:45 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:46.964880 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5ea6c6c-29df-4dcf-a617-776b649ec680 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:46.965934 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5ea6c6c-29df-4dcf-a617-776b649ec680 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:46.973324 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5ea6c6c-29df-4dcf-a617-776b649ec680 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:46.973828 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5ea6c6c-29df-4dcf-a617-776b649ec680 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:46.974621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5ea6c6c-29df-4dcf-a617-776b649ec680 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:46.975049 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5ea6c6c-29df-4dcf-a617-776b649ec680 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:46.992210 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:47.040565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-514c3345-0cd1-49a3-83a2-4ad1d2bc581e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:47.041446 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-514c3345-0cd1-49a3-83a2-4ad1d2bc581e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:47.051170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-514c3345-0cd1-49a3-83a2-4ad1d2bc581e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:47.052227 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-514c3345-0cd1-49a3-83a2-4ad1d2bc581e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:47.053871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-514c3345-0cd1-49a3-83a2-4ad1d2bc581e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:47.054339 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-514c3345-0cd1-49a3-83a2-4ad1d2bc581e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:47.244830 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-d5ea6c6c-29df-4dcf-a617-776b649ec680 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:47.253477 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5ea6c6c-29df-4dcf-a617-776b649ec680 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1691 microversion: 2.1 time: 0.293267 Jul 25 16:29:47.254220 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 245/524] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:46 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1691 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:47.330755 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-514c3345-0cd1-49a3-83a2-4ad1d2bc581e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:47.341293 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-514c3345-0cd1-49a3-83a2-4ad1d2bc581e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.305962 Jul 25 16:29:47.342172 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 280/525] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:47 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:48.277300 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2d00778e-cc9d-4f4f-b53d-436355024453 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:48.277957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2d00778e-cc9d-4f4f-b53d-436355024453 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:48.285446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2d00778e-cc9d-4f4f-b53d-436355024453 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.285870 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2d00778e-cc9d-4f4f-b53d-436355024453 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.286684 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2d00778e-cc9d-4f4f-b53d-436355024453 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.287153 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2d00778e-cc9d-4f4f-b53d-436355024453 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.362588 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dc61e5f0-d752-44ba-993e-bf847d01b7cf tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:48.363881 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dc61e5f0-d752-44ba-993e-bf847d01b7cf tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:48.367045 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:48.367753 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:48.375822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dc61e5f0-d752-44ba-993e-bf847d01b7cf tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.376488 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dc61e5f0-d752-44ba-993e-bf847d01b7cf tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.377562 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dc61e5f0-d752-44ba-993e-bf847d01b7cf tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:48.378273 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dc61e5f0-d752-44ba-993e-bf847d01b7cf tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:48.498759 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2d00778e-cc9d-4f4f-b53d-436355024453 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:48.507150 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2d00778e-cc9d-4f4f-b53d-436355024453 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1691 microversion: 2.1 time: 0.233903 Jul 25 16:29:48.507750 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 246/526] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:48 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1691 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:48.553924 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dc61e5f0-d752-44ba-993e-bf847d01b7cf tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:48.561972 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dc61e5f0-d752-44ba-993e-bf847d01b7cf tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.203726 Jul 25 16:29:48.562651 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 281/527] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:48 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:49.533643 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-df7a827e-7e0b-43db-9769-1e040737d7e5 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:49.534797 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-df7a827e-7e0b-43db-9769-1e040737d7e5 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:49.538186 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:49.549470 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df7a827e-7e0b-43db-9769-1e040737d7e5 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.550223 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df7a827e-7e0b-43db-9769-1e040737d7e5 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.551694 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df7a827e-7e0b-43db-9769-1e040737d7e5 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.552558 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-df7a827e-7e0b-43db-9769-1e040737d7e5 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.584967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-402b17ba-b7ca-450a-a417-2ed96337e89e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:49.586576 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-402b17ba-b7ca-450a-a417-2ed96337e89e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:49.594009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-402b17ba-b7ca-450a-a417-2ed96337e89e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.595838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-402b17ba-b7ca-450a-a417-2ed96337e89e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.597073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-402b17ba-b7ca-450a-a417-2ed96337e89e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.597564 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-402b17ba-b7ca-450a-a417-2ed96337e89e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.823361 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-df7a827e-7e0b-43db-9769-1e040737d7e5 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:49.838401 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-df7a827e-7e0b-43db-9769-1e040737d7e5 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1691 microversion: 2.1 time: 0.310695 Jul 25 16:29:49.844149 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-402b17ba-b7ca-450a-a417-2ed96337e89e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:49.850189 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 247/528] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:49 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1691 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:49.870063 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-402b17ba-b7ca-450a-a417-2ed96337e89e tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.289631 Jul 25 16:29:49.883993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 282/529] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:49 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:49.890731 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ef41b4fa-f497-4925-bf76-9f1016441c39 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:49.890731 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef41b4fa-f497-4925-bf76-9f1016441c39 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:49.899786 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef41b4fa-f497-4925-bf76-9f1016441c39 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.900543 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef41b4fa-f497-4925-bf76-9f1016441c39 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.901622 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef41b4fa-f497-4925-bf76-9f1016441c39 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:49.902138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef41b4fa-f497-4925-bf76-9f1016441c39 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:49.992085 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-fe26356a-3e5d-4e30-999a-b1c286158d0d req-a57d13ce-e242-414f-85d9-d67f6048eeec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ac90f4-881f-449c-831f-30d2a1da6918", "tag": "bb374d5e-fe9e-4511-9e53-90ae0fd8e672"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:50.030264 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-fe26356a-3e5d-4e30-999a-b1c286158d0d req-a57d13ce-e242-414f-85d9-d67f6048eeec service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.033603 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-fe26356a-3e5d-4e30-999a-b1c286158d0d req-a57d13ce-e242-414f-85d9-d67f6048eeec service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.054006 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-ef41b4fa-f497-4925-bf76-9f1016441c39 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lazy-loading 'services' on Instance uuid e1ec0116-debd-4943-b25b-d5862060ae0c {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:50.065216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-fe26356a-3e5d-4e30-999a-b1c286158d0d req-a57d13ce-e242-414f-85d9-d67f6048eeec service nova] Creating event network-changed:bb374d5e-fe9e-4511-9e53-90ae0fd8e672 for instance 14ac90f4-881f-449c-831f-30d2a1da6918 on hv-cinder-83697 Jul 25 16:29:50.079692 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-fe26356a-3e5d-4e30-999a-b1c286158d0d req-a57d13ce-e242-414f-85d9-d67f6048eeec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099658 Jul 25 16:29:50.084223 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 283/530] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:50.258781 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ef41b4fa-f497-4925-bf76-9f1016441c39 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c/os-volume_attachments/77fe5451-68a5-47db-ba45-a970ac382014" status: 202 len: 0 microversion: 2.1 time: 0.381376 Jul 25 16:29:50.263376 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 248/531] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:29:49 2022] DELETE /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c/os-volume_attachments/77fe5451-68a5-47db-ba45-a970ac382014 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:29:50.886672 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4bf9326-eb2f-46f3-a3d7-06cc78aabccb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:50.887545 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4bf9326-eb2f-46f3-a3d7-06cc78aabccb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:50.901511 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4bf9326-eb2f-46f3-a3d7-06cc78aabccb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.902494 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4bf9326-eb2f-46f3-a3d7-06cc78aabccb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.904838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4bf9326-eb2f-46f3-a3d7-06cc78aabccb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.905786 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4bf9326-eb2f-46f3-a3d7-06cc78aabccb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.911869 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c16d249b-f64d-46f5-93be-3b6307e65d19 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:50.913104 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c16d249b-f64d-46f5-93be-3b6307e65d19 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:50.930640 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c16d249b-f64d-46f5-93be-3b6307e65d19 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.931093 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c16d249b-f64d-46f5-93be-3b6307e65d19 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.931920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c16d249b-f64d-46f5-93be-3b6307e65d19 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:50.932360 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c16d249b-f64d-46f5-93be-3b6307e65d19 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:50.998251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4bf9326-eb2f-46f3-a3d7-06cc78aabccb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:51.010129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4bf9326-eb2f-46f3-a3d7-06cc78aabccb tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1623 microversion: 2.1 time: 0.128420 Jul 25 16:29:51.030276 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 284/532] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:50 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1623 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:51.308999 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c16d249b-f64d-46f5-93be-3b6307e65d19 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:51.330577 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c16d249b-f64d-46f5-93be-3b6307e65d19 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.422901 Jul 25 16:29:51.332083 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 249/533] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:50 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:51.415553 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4545ef28-cecf-439d-9dfb-cc344bda492b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:51.416427 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4545ef28-cecf-439d-9dfb-cc344bda492b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:51.426299 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4545ef28-cecf-439d-9dfb-cc344bda492b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:51.427093 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4545ef28-cecf-439d-9dfb-cc344bda492b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:51.428720 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4545ef28-cecf-439d-9dfb-cc344bda492b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:51.430218 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4545ef28-cecf-439d-9dfb-cc344bda492b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:51.492863 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4545ef28-cecf-439d-9dfb-cc344bda492b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:51.560692 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:51.649437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4545ef28-cecf-439d-9dfb-cc344bda492b tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 204 len: 0 microversion: 2.1 time: 0.238599 Jul 25 16:29:51.650399 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 285/534] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:29:51 2022] DELETE /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:51.662919 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-76f600be-a4ae-4ee6-a033-7c578d8e8d13 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:51.663627 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-76f600be-a4ae-4ee6-a033-7c578d8e8d13 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:51.673131 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76f600be-a4ae-4ee6-a033-7c578d8e8d13 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:51.673894 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76f600be-a4ae-4ee6-a033-7c578d8e8d13 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:51.674682 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76f600be-a4ae-4ee6-a033-7c578d8e8d13 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:51.675304 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-76f600be-a4ae-4ee6-a033-7c578d8e8d13 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:51.860332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-76f600be-a4ae-4ee6-a033-7c578d8e8d13 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:51.888466 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-76f600be-a4ae-4ee6-a033-7c578d8e8d13 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1513 microversion: 2.1 time: 0.231663 Jul 25 16:29:51.890065 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 250/535] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:51 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:52.069861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:52.071112 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:52.082426 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.083252 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.085500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.086142 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.140837 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e32c9492-60f8-4baf-8cf8-e402d7101864 req-abe19bd0-65a5-4372-8435-71e415c1d9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "931c107b-f645-476f-9b81-2dab0fedf218", "name": "network-vif-deleted", "tag": "fb6733bd-e84d-4ca0-9190-079f0bc896c0"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:52.148578 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.149660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.150736 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lazy-loading 'fault' on Instance uuid 931c107b-f645-476f-9b81-2dab0fedf218 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:52.162208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e32c9492-60f8-4baf-8cf8-e402d7101864 req-abe19bd0-65a5-4372-8435-71e415c1d9bb service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.162967 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e32c9492-60f8-4baf-8cf8-e402d7101864 req-abe19bd0-65a5-4372-8435-71e415c1d9bb service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.186562 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e32c9492-60f8-4baf-8cf8-e402d7101864 req-abe19bd0-65a5-4372-8435-71e415c1d9bb service nova] Creating event network-vif-deleted:fb6733bd-e84d-4ca0-9190-079f0bc896c0 for instance 931c107b-f645-476f-9b81-2dab0fedf218 on hv-cinder-83697 Jul 25 16:29:52.195323 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e32c9492-60f8-4baf-8cf8-e402d7101864 req-abe19bd0-65a5-4372-8435-71e415c1d9bb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058373 Jul 25 16:29:52.196802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 251/536] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:52.221108 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:52.233391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-437d1095-5c0a-4b99-9944-1de4bc04377a tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1335 microversion: 2.1 time: 0.168529 Jul 25 16:29:52.234406 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 286/537] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:52 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1335 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:52.358003 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ac16be2-2a4f-4508-bb76-7c121a5f9f62 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:52.359337 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5ac16be2-2a4f-4508-bb76-7c121a5f9f62 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:52.368792 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ac16be2-2a4f-4508-bb76-7c121a5f9f62 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.369296 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ac16be2-2a4f-4508-bb76-7c121a5f9f62 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.370264 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ac16be2-2a4f-4508-bb76-7c121a5f9f62 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.371242 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ac16be2-2a4f-4508-bb76-7c121a5f9f62 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.560339 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5ac16be2-2a4f-4508-bb76-7c121a5f9f62 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:52.574528 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5ac16be2-2a4f-4508-bb76-7c121a5f9f62 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.223815 Jul 25 16:29:52.575578 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 252/538] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:52 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:52.912759 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-51a2d31e-5c78-4288-a386-0d27c9d93222 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:52.914409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-51a2d31e-5c78-4288-a386-0d27c9d93222 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:52.925251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51a2d31e-5c78-4288-a386-0d27c9d93222 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.926039 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51a2d31e-5c78-4288-a386-0d27c9d93222 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:52.927464 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51a2d31e-5c78-4288-a386-0d27c9d93222 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:52.928209 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-51a2d31e-5c78-4288-a386-0d27c9d93222 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.111493 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-51a2d31e-5c78-4288-a386-0d27c9d93222 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:53.121376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-51a2d31e-5c78-4288-a386-0d27c9d93222 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1513 microversion: 2.1 time: 0.212817 Jul 25 16:29:53.122050 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 287/539] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:52 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:53.263118 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:53.264067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:53.272372 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.272813 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.273734 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.274194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.317899 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.318832 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.319672 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lazy-loading 'fault' on Instance uuid 931c107b-f645-476f-9b81-2dab0fedf218 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:29:53.369246 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:53.377824 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ec240fbd-b346-46ba-b10e-2e434ffafef0 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 200 len: 1335 microversion: 2.1 time: 0.119215 Jul 25 16:29:53.378428 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 253/540] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:53 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:29:53.606978 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8b26acc5-b016-49c0-a05c-d2dd9e910b8b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:53.607495 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8b26acc5-b016-49c0-a05c-d2dd9e910b8b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:53.614714 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b26acc5-b016-49c0-a05c-d2dd9e910b8b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.615150 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b26acc5-b016-49c0-a05c-d2dd9e910b8b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.615960 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b26acc5-b016-49c0-a05c-d2dd9e910b8b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:53.616503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8b26acc5-b016-49c0-a05c-d2dd9e910b8b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:53.764517 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8b26acc5-b016-49c0-a05c-d2dd9e910b8b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:53.773253 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8b26acc5-b016-49c0-a05c-d2dd9e910b8b tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.170482 Jul 25 16:29:53.773883 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 288/541] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:53 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:54.160896 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b93910e2-10d7-4282-8b84-de7a6ed4974e tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:54.161577 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b93910e2-10d7-4282-8b84-de7a6ed4974e tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:54.168286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93910e2-10d7-4282-8b84-de7a6ed4974e tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.168725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93910e2-10d7-4282-8b84-de7a6ed4974e tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.169542 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93910e2-10d7-4282-8b84-de7a6ed4974e tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.170008 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b93910e2-10d7-4282-8b84-de7a6ed4974e tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.345233 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b93910e2-10d7-4282-8b84-de7a6ed4974e tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:54.360981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b93910e2-10d7-4282-8b84-de7a6ed4974e tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1513 microversion: 2.1 time: 0.204000 Jul 25 16:29:54.362570 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 254/542] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:54 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:54.418236 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:54.419597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 931c107b-f645-476f-9b81-2dab0fedf218] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:54.432392 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.433051 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.434620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.435434 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.462828 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] HTTP exception thrown: Instance 931c107b-f645-476f-9b81-2dab0fedf218 could not be found. Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Request method failure captured: Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 HTTP/1.1 Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sPKb9Fb-vH6xnT2mTjLGFd_QOBpmsX1Y8Rb9D03weDBhasNylRXYbFmkU2x6iERYZs7_9KM7dgcaOtpoTwNfAqLh_Na3tcjAOtL2BmuoAUQGulpjfzj19IPXftQo2eRfFhz3u8oML9jDvt8ZBdSwS3KFDldQI-3LKks8yVzk6uD41w Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:29:54.466444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18b6e0eaf4eb48868a683c7769d3df7a"}]}] Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 2d1eb89923784f1c83d2077c6b6926e9 Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 931c107b-f645-476f-9b81-2dab0fedf218 could not be found. Jul 25 16:29:54.469141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '931c107b-f645-476f-9b81-2dab0fedf218'} Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 931c107b-f645-476f-9b81-2dab0fedf218 could not be found. Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:54.471569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 931c107b-f645-476f-9b81-2dab0fedf218 could not be found. Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 931c107b-f645-476f-9b81-2dab0fedf218 could not be found. Jul 25 16:29:54.474967 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:54.481574 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Returning 404 to user: Instance 931c107b-f645-476f-9b81-2dab0fedf218 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:54.481574 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4faaa69e-a934-4871-8efd-34f12ccac36f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218" status: 404 len: 111 microversion: 2.1 time: 0.057787 Jul 25 16:29:54.484431 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-93c63b50-464d-449c-b289-ee37c4c7b65f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '.version_select at 0x7f441008b0d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:54.485482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 289/543] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:54 2022] GET /compute/v2.1/servers/931c107b-f645-476f-9b81-2dab0fedf218 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:54.515009 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-93c63b50-464d-449c-b289-ee37c4c7b65f tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833309268" status: 202 len: 0 microversion: 2.1 time: 0.038243 Jul 25 16:29:54.515959 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 255/544] 10.222.0.66 () {58 vars in 1221 bytes} [Mon Jul 25 16:29:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833309268 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:29:54.796423 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1a88c22f-6ee5-4f37-be5b-e229b6d6f09a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:54.797537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1a88c22f-6ee5-4f37-be5b-e229b6d6f09a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:54.807220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a88c22f-6ee5-4f37-be5b-e229b6d6f09a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.807673 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a88c22f-6ee5-4f37-be5b-e229b6d6f09a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:54.808932 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a88c22f-6ee5-4f37-be5b-e229b6d6f09a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:54.809706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1a88c22f-6ee5-4f37-be5b-e229b6d6f09a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:55.191260 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1a88c22f-6ee5-4f37-be5b-e229b6d6f09a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:55.206496 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1a88c22f-6ee5-4f37-be5b-e229b6d6f09a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.414884 Jul 25 16:29:55.207657 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 290/545] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:54 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:55.401259 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b0b125d1-48fb-4a17-ad9e-2c512bf6325a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:55.403091 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b0b125d1-48fb-4a17-ad9e-2c512bf6325a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:55.421576 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0b125d1-48fb-4a17-ad9e-2c512bf6325a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:55.422939 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0b125d1-48fb-4a17-ad9e-2c512bf6325a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:55.426235 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0b125d1-48fb-4a17-ad9e-2c512bf6325a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:55.427596 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0b125d1-48fb-4a17-ad9e-2c512bf6325a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:55.610985 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b0b125d1-48fb-4a17-ad9e-2c512bf6325a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e1898925cd4feea900627bc0ee8a7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b5f7127564335a847ab40761124df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:55.623133 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b0b125d1-48fb-4a17-ad9e-2c512bf6325a tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 200 len: 1471 microversion: 2.1 time: 0.230936 Jul 25 16:29:55.637821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 256/546] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:55 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:55.639366 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-f450ae50-615f-426b-a856-7e234b3e49d3 req-97cec693-ae18-4499-af80-3a287a13e843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1ec0116-debd-4943-b25b-d5862060ae0c", "name": "network-vif-deleted", "tag": "a0f8c860-81a3-4e61-828b-b3a04c3c4c98"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:55.666855 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-f450ae50-615f-426b-a856-7e234b3e49d3 req-97cec693-ae18-4499-af80-3a287a13e843 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:55.669710 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-f450ae50-615f-426b-a856-7e234b3e49d3 req-97cec693-ae18-4499-af80-3a287a13e843 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:55.704113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-f450ae50-615f-426b-a856-7e234b3e49d3 req-97cec693-ae18-4499-af80-3a287a13e843 service nova] Creating event network-vif-deleted:a0f8c860-81a3-4e61-828b-b3a04c3c4c98 for instance e1ec0116-debd-4943-b25b-d5862060ae0c on hv-cinder-83697 Jul 25 16:29:55.712256 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-f450ae50-615f-426b-a856-7e234b3e49d3 req-97cec693-ae18-4499-af80-3a287a13e843 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090413 Jul 25 16:29:55.714354 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 291/547] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:29:56.244445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ed5e0305-ed55-473a-9a91-83d49b42abdc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:56.245688 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ed5e0305-ed55-473a-9a91-83d49b42abdc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:56.257244 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed5e0305-ed55-473a-9a91-83d49b42abdc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:56.257965 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed5e0305-ed55-473a-9a91-83d49b42abdc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:56.259292 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed5e0305-ed55-473a-9a91-83d49b42abdc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:56.260053 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ed5e0305-ed55-473a-9a91-83d49b42abdc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:56.424159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ed5e0305-ed55-473a-9a91-83d49b42abdc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:56.437257 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ed5e0305-ed55-473a-9a91-83d49b42abdc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.200827 Jul 25 16:29:56.438375 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 257/548] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:56 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:56.648251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:56.649004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] [instance: e1ec0116-debd-4943-b25b-d5862060ae0c] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:56.656613 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:56.657320 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:56.658328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:56.658834 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:56.676461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] HTTP exception thrown: Instance e1ec0116-debd-4943-b25b-d5862060ae0c could not be found. Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Request method failure captured: Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c HTTP/1.1 Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sRgFZidPOzhQSHuudUzvaAz8ZQKm3_5Gc-EubNPMZAOpCzA8AdwhwjS01bFxU6eXIbe6OoH2_Ud3rE_Hv5lRZbKcIonrvZmzhH4Ed5FiUSutDtf6EbT_lGFVzY3MK1nAQReqcaN-ddoXEbk3P70EAp8JrI5Zi1rEhH55PoBNHlS2Oo Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: bd9b5f7127564335a847ab40761124df Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesSnapshotTestJSON-248873339 Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:29:56.678286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/bd9b5f7127564335a847ab40761124df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd9b5f7127564335a847ab40761124df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/bd9b5f7127564335a847ab40761124df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_bd9b5f7127564335a847ab40761124df"}]}] Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesSnapshotTestJSON-248873339 Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: bd9b5f7127564335a847ab40761124df Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-248873339 Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesSnapshotTestJSON-248873339-project Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: c7e1898925cd4feea900627bc0ee8a7a Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesSnapshotTestJSON-248873339-project Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance e1ec0116-debd-4943-b25b-d5862060ae0c could not be found. Jul 25 16:29:56.679952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'e1ec0116-debd-4943-b25b-d5862060ae0c'} Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1ec0116-debd-4943-b25b-d5862060ae0c could not be found. Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:29:56.680812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1ec0116-debd-4943-b25b-d5862060ae0c could not be found. Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1ec0116-debd-4943-b25b-d5862060ae0c could not be found. Jul 25 16:29:56.682295 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:29:56.683795 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] Returning 404 to user: Instance e1ec0116-debd-4943-b25b-d5862060ae0c could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:29:56.683795 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-04d6238e-9f52-4d2e-b600-16025250a2d4 tempest-VolumesSnapshotTestJSON-248873339 tempest-VolumesSnapshotTestJSON-248873339-project] 10.222.0.66 "GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c" status: 404 len: 111 microversion: 2.1 time: 0.036963 Jul 25 16:29:56.683795 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 292/549] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:56 2022] GET /compute/v2.1/servers/e1ec0116-debd-4943-b25b-d5862060ae0c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:29:57.461799 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-87734904-9791-4c4b-9987-3e0b7580d12c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:57.462888 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-87734904-9791-4c4b-9987-3e0b7580d12c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:57.466464 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:29:57.480662 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87734904-9791-4c4b-9987-3e0b7580d12c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:57.481280 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87734904-9791-4c4b-9987-3e0b7580d12c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:57.482413 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87734904-9791-4c4b-9987-3e0b7580d12c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:57.482973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87734904-9791-4c4b-9987-3e0b7580d12c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:57.550237 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-73e52c8e-c2df-425c-baf8-605087cfd1e4 req-4b77a3b4-1d44-4bd0-8880-9d3676988ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ac90f4-881f-449c-831f-30d2a1da6918", "name": "network-vif-plugged", "status": "completed", "tag": "bb374d5e-fe9e-4511-9e53-90ae0fd8e672"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:29:57.562392 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-73e52c8e-c2df-425c-baf8-605087cfd1e4 req-4b77a3b4-1d44-4bd0-8880-9d3676988ee3 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:57.562912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-73e52c8e-c2df-425c-baf8-605087cfd1e4 req-4b77a3b4-1d44-4bd0-8880-9d3676988ee3 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:57.583645 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-73e52c8e-c2df-425c-baf8-605087cfd1e4 req-4b77a3b4-1d44-4bd0-8880-9d3676988ee3 service nova] Creating event network-vif-plugged:bb374d5e-fe9e-4511-9e53-90ae0fd8e672 for instance 14ac90f4-881f-449c-831f-30d2a1da6918 on hv-cinder-83697 Jul 25 16:29:57.590161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-73e52c8e-c2df-425c-baf8-605087cfd1e4 req-4b77a3b4-1d44-4bd0-8880-9d3676988ee3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044762 Jul 25 16:29:57.591489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 293/550] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:29:57.694735 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-87734904-9791-4c4b-9987-3e0b7580d12c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:57.705671 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-87734904-9791-4c4b-9987-3e0b7580d12c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.248540 Jul 25 16:29:57.720117 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 258/551] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:57 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:58.131083 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9c7b8cd0-6b72-4c4d-a7fa-6de888ad0de7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:58.131906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9c7b8cd0-6b72-4c4d-a7fa-6de888ad0de7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:58.141218 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c7b8cd0-6b72-4c4d-a7fa-6de888ad0de7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.141790 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c7b8cd0-6b72-4c4d-a7fa-6de888ad0de7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.142813 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c7b8cd0-6b72-4c4d-a7fa-6de888ad0de7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.143395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9c7b8cd0-6b72-4c4d-a7fa-6de888ad0de7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.180324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9c7b8cd0-6b72-4c4d-a7fa-6de888ad0de7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:29:58.291859 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9c7b8cd0-6b72-4c4d-a7fa-6de888ad0de7 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 204 len: 0 microversion: 2.1 time: 0.165581 Jul 25 16:29:58.293971 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 294/552] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:29:58 2022] DELETE /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:29:58.308129 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1ee860b1-2d8c-4a60-9ad7-8739c25a8147 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:58.309827 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1ee860b1-2d8c-4a60-9ad7-8739c25a8147 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:58.321059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ee860b1-2d8c-4a60-9ad7-8739c25a8147 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.321599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ee860b1-2d8c-4a60-9ad7-8739c25a8147 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.322471 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ee860b1-2d8c-4a60-9ad7-8739c25a8147 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.323914 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1ee860b1-2d8c-4a60-9ad7-8739c25a8147 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.505494 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1ee860b1-2d8c-4a60-9ad7-8739c25a8147 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:58.515425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1ee860b1-2d8c-4a60-9ad7-8739c25a8147 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1509 microversion: 2.1 time: 0.215628 Jul 25 16:29:58.516102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 259/553] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:58 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:58.734399 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3610e987-ffce-42a9-aa78-2ad508c53145 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:58.735107 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3610e987-ffce-42a9-aa78-2ad508c53145 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:58.742566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3610e987-ffce-42a9-aa78-2ad508c53145 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.743032 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3610e987-ffce-42a9-aa78-2ad508c53145 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.743868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3610e987-ffce-42a9-aa78-2ad508c53145 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:58.744274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3610e987-ffce-42a9-aa78-2ad508c53145 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:58.940361 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3610e987-ffce-42a9-aa78-2ad508c53145 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:58.954804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3610e987-ffce-42a9-aa78-2ad508c53145 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.225866 Jul 25 16:29:58.955888 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 295/554] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:58 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:59.537569 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-89dba032-dbb9-4fc6-b3dd-f260e027fbfe tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:59.538598 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-89dba032-dbb9-4fc6-b3dd-f260e027fbfe tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:59.547275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89dba032-dbb9-4fc6-b3dd-f260e027fbfe tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:59.547846 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89dba032-dbb9-4fc6-b3dd-f260e027fbfe tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:59.549182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89dba032-dbb9-4fc6-b3dd-f260e027fbfe tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:59.549659 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-89dba032-dbb9-4fc6-b3dd-f260e027fbfe tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:59.721189 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-89dba032-dbb9-4fc6-b3dd-f260e027fbfe tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:29:59.729870 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-89dba032-dbb9-4fc6-b3dd-f260e027fbfe tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1509 microversion: 2.1 time: 0.196522 Jul 25 16:29:59.730703 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 260/555] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:59 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:29:59.978348 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-140ae79a-daa9-4ec6-bf31-a432aa53e4bb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:29:59.979027 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-140ae79a-daa9-4ec6-bf31-a432aa53e4bb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:29:59.986433 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-140ae79a-daa9-4ec6-bf31-a432aa53e4bb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:59.986957 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-140ae79a-daa9-4ec6-bf31-a432aa53e4bb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:29:59.988351 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-140ae79a-daa9-4ec6-bf31-a432aa53e4bb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:29:59.988826 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-140ae79a-daa9-4ec6-bf31-a432aa53e4bb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:00.145282 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-140ae79a-daa9-4ec6-bf31-a432aa53e4bb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:00.153539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-140ae79a-daa9-4ec6-bf31-a432aa53e4bb tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.179268 Jul 25 16:30:00.154144 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 296/556] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:29:59 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:00.752882 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9f3091b0-08e8-4eb3-a24d-5b2c717abf08 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:00.753676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9f3091b0-08e8-4eb3-a24d-5b2c717abf08 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:00.762033 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f3091b0-08e8-4eb3-a24d-5b2c717abf08 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:00.762697 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f3091b0-08e8-4eb3-a24d-5b2c717abf08 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:00.763881 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f3091b0-08e8-4eb3-a24d-5b2c717abf08 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:00.764337 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9f3091b0-08e8-4eb3-a24d-5b2c717abf08 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:00.938599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9f3091b0-08e8-4eb3-a24d-5b2c717abf08 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:00.947519 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9f3091b0-08e8-4eb3-a24d-5b2c717abf08 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1509 microversion: 2.1 time: 0.198907 Jul 25 16:30:00.948126 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 261/557] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:00 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:01.175187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-928c82c7-cef1-498f-9755-25ddd2f7060f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:01.175759 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-928c82c7-cef1-498f-9755-25ddd2f7060f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:01.182928 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-928c82c7-cef1-498f-9755-25ddd2f7060f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:01.183384 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-928c82c7-cef1-498f-9755-25ddd2f7060f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:01.184201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-928c82c7-cef1-498f-9755-25ddd2f7060f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:01.184637 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-928c82c7-cef1-498f-9755-25ddd2f7060f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:01.351566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-928c82c7-cef1-498f-9755-25ddd2f7060f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:01.365894 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-928c82c7-cef1-498f-9755-25ddd2f7060f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.194385 Jul 25 16:30:01.366777 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 297/558] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:01 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:01.977452 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8cefd6a-c563-4550-af80-89d8dbf1ec35 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:01.990783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8cefd6a-c563-4550-af80-89d8dbf1ec35 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:02.005466 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8cefd6a-c563-4550-af80-89d8dbf1ec35 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:02.006100 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8cefd6a-c563-4550-af80-89d8dbf1ec35 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:02.008409 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8cefd6a-c563-4550-af80-89d8dbf1ec35 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:02.009287 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8cefd6a-c563-4550-af80-89d8dbf1ec35 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:02.198000 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8cefd6a-c563-4550-af80-89d8dbf1ec35 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:02.200344 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:02.208933 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8cefd6a-c563-4550-af80-89d8dbf1ec35 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1509 microversion: 2.1 time: 0.244240 Jul 25 16:30:02.209723 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 262/559] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:01 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:02.399244 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0e03b11a-192b-4945-9b09-45b453d87f9a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:02.400036 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0e03b11a-192b-4945-9b09-45b453d87f9a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:02.407657 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e03b11a-192b-4945-9b09-45b453d87f9a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:02.408095 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e03b11a-192b-4945-9b09-45b453d87f9a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:02.409232 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e03b11a-192b-4945-9b09-45b453d87f9a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:02.409444 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0e03b11a-192b-4945-9b09-45b453d87f9a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:02.579190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0e03b11a-192b-4945-9b09-45b453d87f9a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:02.594033 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0e03b11a-192b-4945-9b09-45b453d87f9a tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1363 microversion: 2.1 time: 0.198743 Jul 25 16:30:02.595727 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 298/560] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:02 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:03.118268 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-8d39756c-a6b5-4cbc-af54-5cb9143c93a3 req-e411ef09-5b82-4aae-9199-c025c50d4b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a766e06-b19b-4fd9-9f31-7ef4af533654", "name": "network-vif-deleted", "tag": "1ea0fdf3-0f2b-440a-ac9c-39e48abc4a64"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:03.136572 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8d39756c-a6b5-4cbc-af54-5cb9143c93a3 req-e411ef09-5b82-4aae-9199-c025c50d4b5c service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.137833 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-8d39756c-a6b5-4cbc-af54-5cb9143c93a3 req-e411ef09-5b82-4aae-9199-c025c50d4b5c service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.162560 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-8d39756c-a6b5-4cbc-af54-5cb9143c93a3 req-e411ef09-5b82-4aae-9199-c025c50d4b5c service nova] Creating event network-vif-deleted:1ea0fdf3-0f2b-440a-ac9c-39e48abc4a64 for instance 9a766e06-b19b-4fd9-9f31-7ef4af533654 on hv-cinder-83697 Jul 25 16:30:03.171977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-8d39756c-a6b5-4cbc-af54-5cb9143c93a3 req-e411ef09-5b82-4aae-9199-c025c50d4b5c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160544 Jul 25 16:30:03.173259 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 263/561] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:03.244268 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:03.245044 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:03.253518 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.254066 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.255384 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.256159 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.328055 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.329067 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.329952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lazy-loading 'fault' on Instance uuid 9a766e06-b19b-4fd9-9f31-7ef4af533654 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:30:03.402835 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:03.412209 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-493fe4db-689a-47b2-88d1-fe3d82277972 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 200 len: 1312 microversion: 2.1 time: 0.172822 Jul 25 16:30:03.412812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 299/562] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:03 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:03.620848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a526bb7c-26d3-4d8c-8e3a-1af4dcd92fa2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:03.621669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a526bb7c-26d3-4d8c-8e3a-1af4dcd92fa2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:03.631883 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a526bb7c-26d3-4d8c-8e3a-1af4dcd92fa2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.632368 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a526bb7c-26d3-4d8c-8e3a-1af4dcd92fa2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.633202 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a526bb7c-26d3-4d8c-8e3a-1af4dcd92fa2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.633680 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a526bb7c-26d3-4d8c-8e3a-1af4dcd92fa2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.671193 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-91b7c7db-56c4-4c48-a983-577c21987f04 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1303945712"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:03.672312 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-91b7c7db-56c4-4c48-a983-577c21987f04 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:03.687440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-91b7c7db-56c4-4c48-a983-577c21987f04 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.688345 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-91b7c7db-56c4-4c48-a983-577c21987f04 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.689950 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-91b7c7db-56c4-4c48-a983-577c21987f04 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.690906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-91b7c7db-56c4-4c48-a983-577c21987f04 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.857955 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a526bb7c-26d3-4d8c-8e3a-1af4dcd92fa2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:03.874803 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a526bb7c-26d3-4d8c-8e3a-1af4dcd92fa2 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1547 microversion: 2.1 time: 0.258242 Jul 25 16:30:03.889478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 264/563] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:03 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1547 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:03.926143 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f19a58c8-3e4a-4413-875f-1f5d72022ba8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:03.927105 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f19a58c8-3e4a-4413-875f-1f5d72022ba8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:03.928824 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.network.security_group_api [None req-91b7c7db-56c4-4c48-a983-577c21987f04 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Removing security group c9f95b60-180b-4387-9ca4-21df6638e22e from port 9a46516f-6426-4c10-a5d9-637e54e69b85 Jul 25 16:30:03.939955 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f19a58c8-3e4a-4413-875f-1f5d72022ba8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.942382 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f19a58c8-3e4a-4413-875f-1f5d72022ba8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:03.944918 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f19a58c8-3e4a-4413-875f-1f5d72022ba8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:03.946022 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f19a58c8-3e4a-4413-875f-1f5d72022ba8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:04.096862 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f19a58c8-3e4a-4413-875f-1f5d72022ba8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185913 Jul 25 16:30:04.098043 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 265/564] 10.222.0.66 () {58 vars in 1275 bytes} [Mon Jul 25 16:30:03 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-interface => generated 284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:04.428081 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-91b7c7db-56c4-4c48-a983-577c21987f04 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "POST /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/action" status: 202 len: 0 microversion: 2.1 time: 0.758875 Jul 25 16:30:04.428081 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 300/565] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:30:03 2022] POST /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:30:04.443191 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-a2e30839-327b-424c-a035-3494216b9d34 req-77e205a7-dddf-4248-b1b8-264856128bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550fc385-910d-4a1a-8d15-13f92691d031", "tag": "9a46516f-6426-4c10-a5d9-637e54e69b85"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:04.455853 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:04.456838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: 9a766e06-b19b-4fd9-9f31-7ef4af533654] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:04.463798 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-a2e30839-327b-424c-a035-3494216b9d34 req-77e205a7-dddf-4248-b1b8-264856128bda service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:04.464358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-a2e30839-327b-424c-a035-3494216b9d34 req-77e205a7-dddf-4248-b1b8-264856128bda service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:04.485825 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:04.486437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:04.490384 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:04.490870 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:04.506645 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-a2e30839-327b-424c-a035-3494216b9d34 req-77e205a7-dddf-4248-b1b8-264856128bda service nova] Creating event network-changed:9a46516f-6426-4c10-a5d9-637e54e69b85 for instance 550fc385-910d-4a1a-8d15-13f92691d031 on hv-cinder-83697 Jul 25 16:30:04.528979 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-a2e30839-327b-424c-a035-3494216b9d34 req-77e205a7-dddf-4248-b1b8-264856128bda service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091474 Jul 25 16:30:04.531010 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 301/566] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:30:04.531798 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] HTTP exception thrown: Instance 9a766e06-b19b-4fd9-9f31-7ef4af533654 could not be found. Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Request method failure captured: Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 HTTP/1.1 Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sPKb9Fb-vH6xnT2mTjLGFd_QOBpmsX1Y8Rb9D03weDBhasNylRXYbFmkU2x6iERYZs7_9KM7dgcaOtpoTwNfAqLh_Na3tcjAOtL2BmuoAUQGulpjfzj19IPXftQo2eRfFhz3u8oML9jDvt8ZBdSwS3KFDldQI-3LKks8yVzk6uD41w Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:30:04.544204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18b6e0eaf4eb48868a683c7769d3df7a"}]}] Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 2d1eb89923784f1c83d2077c6b6926e9 Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 9a766e06-b19b-4fd9-9f31-7ef4af533654 could not be found. Jul 25 16:30:04.547199 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '9a766e06-b19b-4fd9-9f31-7ef4af533654'} Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a766e06-b19b-4fd9-9f31-7ef4af533654 could not be found. Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:04.548913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a766e06-b19b-4fd9-9f31-7ef4af533654 could not be found. Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a766e06-b19b-4fd9-9f31-7ef4af533654 could not be found. Jul 25 16:30:04.552047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:04.558205 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Returning 404 to user: Instance 9a766e06-b19b-4fd9-9f31-7ef4af533654 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:04.558205 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b447cf26-ad18-4bee-b6f8-1c1a60b81f36 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654" status: 404 len: 111 microversion: 2.1 time: 0.114295 Jul 25 16:30:04.558205 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 266/567] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:04 2022] GET /compute/v2.1/servers/9a766e06-b19b-4fd9-9f31-7ef4af533654 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:30:04.565790 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-402f3778-4366-4adf-99de-023f1baaa36d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:04.570856 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-402f3778-4366-4adf-99de-023f1baaa36d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:04.598007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-402f3778-4366-4adf-99de-023f1baaa36d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:04.599527 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-402f3778-4366-4adf-99de-023f1baaa36d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:04.609735 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-402f3778-4366-4adf-99de-023f1baaa36d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:04.611007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-402f3778-4366-4adf-99de-023f1baaa36d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:04.694680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-402f3778-4366-4adf-99de-023f1baaa36d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:30:04.848546 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:05.016735 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-402f3778-4366-4adf-99de-023f1baaa36d tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 204 len: 0 microversion: 2.1 time: 0.459426 Jul 25 16:30:05.019133 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 302/568] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:30:04 2022] DELETE /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:30:05.036104 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-751026ed-80fc-4091-8264-4be43a2df431 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:05.037922 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-751026ed-80fc-4091-8264-4be43a2df431 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:05.055931 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-751026ed-80fc-4091-8264-4be43a2df431 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:05.056958 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-751026ed-80fc-4091-8264-4be43a2df431 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:05.058821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-751026ed-80fc-4091-8264-4be43a2df431 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:05.059907 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-751026ed-80fc-4091-8264-4be43a2df431 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:05.469962 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-751026ed-80fc-4091-8264-4be43a2df431 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:05.486149 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-751026ed-80fc-4091-8264-4be43a2df431 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.459918 Jul 25 16:30:05.487395 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 267/569] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:05 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:05.776493 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-ce04fd6a-0c43-4d66-b8b6-645b00573956 req-39361077-0560-4753-a05a-abcc259cba75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14ac90f4-881f-449c-831f-30d2a1da6918", "tag": "bb374d5e-fe9e-4511-9e53-90ae0fd8e672"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:05.788415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ce04fd6a-0c43-4d66-b8b6-645b00573956 req-39361077-0560-4753-a05a-abcc259cba75 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:05.788872 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-ce04fd6a-0c43-4d66-b8b6-645b00573956 req-39361077-0560-4753-a05a-abcc259cba75 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:05.803812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-ce04fd6a-0c43-4d66-b8b6-645b00573956 req-39361077-0560-4753-a05a-abcc259cba75 service nova] Creating event network-changed:bb374d5e-fe9e-4511-9e53-90ae0fd8e672 for instance 14ac90f4-881f-449c-831f-30d2a1da6918 on hv-cinder-83697 Jul 25 16:30:05.810070 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-ce04fd6a-0c43-4d66-b8b6-645b00573956 req-39361077-0560-4753-a05a-abcc259cba75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038584 Jul 25 16:30:05.810808 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 303/570] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:30:06.520599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f27e7e89-f9ca-4764-a28b-0cc994e98b94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:06.526499 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f27e7e89-f9ca-4764-a28b-0cc994e98b94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:06.558661 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f27e7e89-f9ca-4764-a28b-0cc994e98b94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.562189 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f27e7e89-f9ca-4764-a28b-0cc994e98b94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.563062 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f27e7e89-f9ca-4764-a28b-0cc994e98b94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.563497 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f27e7e89-f9ca-4764-a28b-0cc994e98b94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.942525 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3fe96d69-122a-41ca-b7ed-1c24e6770ea5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:06.943791 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3fe96d69-122a-41ca-b7ed-1c24e6770ea5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:06.953380 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fe96d69-122a-41ca-b7ed-1c24e6770ea5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.954947 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fe96d69-122a-41ca-b7ed-1c24e6770ea5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:06.956029 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fe96d69-122a-41ca-b7ed-1c24e6770ea5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:06.956730 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3fe96d69-122a-41ca-b7ed-1c24e6770ea5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:07.057852 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f27e7e89-f9ca-4764-a28b-0cc994e98b94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:07.072619 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f27e7e89-f9ca-4764-a28b-0cc994e98b94 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.559766 Jul 25 16:30:07.074052 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 268/571] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:06 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:07.080034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-46f0b35c-c9bd-4dfe-87f8-cdae62266cf3 req-16b75a29-853a-4ba5-89a7-05e5bd7aa47e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550fc385-910d-4a1a-8d15-13f92691d031", "tag": "9a46516f-6426-4c10-a5d9-637e54e69b85"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:07.096728 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-46f0b35c-c9bd-4dfe-87f8-cdae62266cf3 req-16b75a29-853a-4ba5-89a7-05e5bd7aa47e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:07.097458 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-46f0b35c-c9bd-4dfe-87f8-cdae62266cf3 req-16b75a29-853a-4ba5-89a7-05e5bd7aa47e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:07.122856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-46f0b35c-c9bd-4dfe-87f8-cdae62266cf3 req-16b75a29-853a-4ba5-89a7-05e5bd7aa47e service nova] Creating event network-changed:9a46516f-6426-4c10-a5d9-637e54e69b85 for instance 550fc385-910d-4a1a-8d15-13f92691d031 on hv-cinder-83697 Jul 25 16:30:07.132910 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-46f0b35c-c9bd-4dfe-87f8-cdae62266cf3 req-16b75a29-853a-4ba5-89a7-05e5bd7aa47e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056635 Jul 25 16:30:07.134330 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 269/572] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:07.141181 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-3fe96d69-122a-41ca-b7ed-1c24e6770ea5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lazy-loading 'services' on Instance uuid 550fc385-910d-4a1a-8d15-13f92691d031 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:30:07.272872 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3fe96d69-122a-41ca-b7ed-1c24e6770ea5 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "DELETE /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments/f33c27b3-bc39-4d6b-ac61-3814f486b7d7" status: 202 len: 0 microversion: 2.1 time: 0.338958 Jul 25 16:30:07.274369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 304/573] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:30:06 2022] DELETE /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments/f33c27b3-bc39-4d6b-ac61-3814f486b7d7 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:30:07.287798 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5e9c8d0c-0576-4662-a1ca-e4398a01104a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:07.292750 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5e9c8d0c-0576-4662-a1ca-e4398a01104a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:07.303415 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e9c8d0c-0576-4662-a1ca-e4398a01104a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:07.303914 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e9c8d0c-0576-4662-a1ca-e4398a01104a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:07.304800 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e9c8d0c-0576-4662-a1ca-e4398a01104a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:07.305492 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e9c8d0c-0576-4662-a1ca-e4398a01104a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:07.372658 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5e9c8d0c-0576-4662-a1ca-e4398a01104a tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092074 Jul 25 16:30:07.373727 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 270/574] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:30:07 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:08.105242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4501609-549b-48c3-8c8d-24b56b15c1bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:08.106422 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4501609-549b-48c3-8c8d-24b56b15c1bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:08.118441 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4501609-549b-48c3-8c8d-24b56b15c1bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:08.119040 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4501609-549b-48c3-8c8d-24b56b15c1bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.120383 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4501609-549b-48c3-8c8d-24b56b15c1bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:08.121107 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4501609-549b-48c3-8c8d-24b56b15c1bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.340748 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4501609-549b-48c3-8c8d-24b56b15c1bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:08.349811 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4501609-549b-48c3-8c8d-24b56b15c1bd tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.253043 Jul 25 16:30:08.350452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 305/575] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:08 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:08.392316 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d07b52f-93c6-4c4c-8969-655dc42ce01e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:08.396070 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7d07b52f-93c6-4c4c-8969-655dc42ce01e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:08.408254 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d07b52f-93c6-4c4c-8969-655dc42ce01e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:08.408973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d07b52f-93c6-4c4c-8969-655dc42ce01e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.410491 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d07b52f-93c6-4c4c-8969-655dc42ce01e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:08.411251 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d07b52f-93c6-4c4c-8969-655dc42ce01e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:08.451559 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7d07b52f-93c6-4c4c-8969-655dc42ce01e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066853 Jul 25 16:30:08.452272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 271/576] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:30:08 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:09.373616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bb5be236-e457-4f6d-aacd-f002da7549ea tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:09.374554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bb5be236-e457-4f6d-aacd-f002da7549ea tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:09.378141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93,nova_api:UPDATE=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:09.386360 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb5be236-e457-4f6d-aacd-f002da7549ea tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.386929 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb5be236-e457-4f6d-aacd-f002da7549ea tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:09.387905 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb5be236-e457-4f6d-aacd-f002da7549ea tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.388436 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bb5be236-e457-4f6d-aacd-f002da7549ea tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:09.478174 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dc33393c-d689-4066-a5cf-5ae4b922b987 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:09.483148 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dc33393c-d689-4066-a5cf-5ae4b922b987 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:09.498202 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc33393c-d689-4066-a5cf-5ae4b922b987 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.498938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc33393c-d689-4066-a5cf-5ae4b922b987 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:09.500623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc33393c-d689-4066-a5cf-5ae4b922b987 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:09.501326 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc33393c-d689-4066-a5cf-5ae4b922b987 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:09.560460 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dc33393c-d689-4066-a5cf-5ae4b922b987 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091429 Jul 25 16:30:09.561965 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 272/577] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:30:09 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:09.620403 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bb5be236-e457-4f6d-aacd-f002da7549ea tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:09.630314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bb5be236-e457-4f6d-aacd-f002da7549ea tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.261201 Jul 25 16:30:09.630981 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 306/578] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:09 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:10.578525 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ced0cb12-a7e1-4d91-8c97-0121bb3643f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:10.586492 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ced0cb12-a7e1-4d91-8c97-0121bb3643f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:10.609224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ced0cb12-a7e1-4d91-8c97-0121bb3643f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.610889 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ced0cb12-a7e1-4d91-8c97-0121bb3643f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.621818 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ced0cb12-a7e1-4d91-8c97-0121bb3643f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.622544 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ced0cb12-a7e1-4d91-8c97-0121bb3643f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.665281 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a88c2d03-9df2-4975-8e1c-9fef39059514 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:10.667578 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a88c2d03-9df2-4975-8e1c-9fef39059514 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:10.680394 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88c2d03-9df2-4975-8e1c-9fef39059514 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.681310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88c2d03-9df2-4975-8e1c-9fef39059514 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.683207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88c2d03-9df2-4975-8e1c-9fef39059514 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.684347 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a88c2d03-9df2-4975-8e1c-9fef39059514 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.693621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ced0cb12-a7e1-4d91-8c97-0121bb3643f6 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120614 Jul 25 16:30:10.695495 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 273/579] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:30:10 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:30:10.716113 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:10.716814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:10.727734 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.728447 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.732026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:10.733118 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:10.910761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] HTTP exception thrown: Instance 550fc385-910d-4a1a-8d15-13f92691d031 is not attached to volume f33c27b3-bc39-4d6b-ac61-3814f486b7d7 Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Request method failure captured: Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments/f33c27b3-bc39-4d6b-ac61-3814f486b7d7 HTTP/1.1 Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sRFh-q_1D5imChmCt91hbjxwg56sXeYmtRaTigu9Hm972Uh5CeBPjFSdSTA-eN6dc8ASmybPFZzfWfITUQOzyyyd353gBIef0lbdvuxhSlpN_vCO85hUZ1NnqdkXOkJn-sjJkIBp30r0wGZzYgw9lJEW0iaaSFmlam2XQWtv79T1C4 Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 966cf8bbbc4540a596f615498331465a Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestMinimumBasicScenario-104242772 Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:30:10.914311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/966cf8bbbc4540a596f615498331465a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/966cf8bbbc4540a596f615498331465a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/966cf8bbbc4540a596f615498331465a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_966cf8bbbc4540a596f615498331465a"}]}] Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestMinimumBasicScenario-104242772 Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 966cf8bbbc4540a596f615498331465a Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestMinimumBasicScenario-104242772 Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-TestMinimumBasicScenario-104242772-project Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 55d7bbda47b64493a840fef8c6c40431 Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestMinimumBasicScenario-104242772-project Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:30:10.916929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 550fc385-910d-4a1a-8d15-13f92691d031 is not attached to volume f33c27b3-bc39-4d6b-ac61-3814f486b7d7 Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '550fc385-910d-4a1a-8d15-13f92691d031', 'id': 'f33c27b3-bc39-4d6b-ac61-3814f486b7d7'} Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f33c27b3-bc39-4d6b-ac61-3814f486b7d7. Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:10.918516 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550fc385-910d-4a1a-8d15-13f92691d031 is not attached to volume f33c27b3-bc39-4d6b-ac61-3814f486b7d7 Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550fc385-910d-4a1a-8d15-13f92691d031 is not attached to volume f33c27b3-bc39-4d6b-ac61-3814f486b7d7 Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:30:10.920920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Returning 404 to user: Instance 550fc385-910d-4a1a-8d15-13f92691d031 is not attached to volume f33c27b3-bc39-4d6b-ac61-3814f486b7d7 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:10.923629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-52f98803-cd14-4264-838c-c20fdc5495ff tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "DELETE /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments/f33c27b3-bc39-4d6b-ac61-3814f486b7d7" status: 404 len: 154 microversion: 2.1 time: 0.212917 Jul 25 16:30:10.923629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 274/580] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:30:10 2022] DELETE /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031/os-volume_attachments/f33c27b3-bc39-4d6b-ac61-3814f486b7d7 => generated 154 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:30:11.011566 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a88c2d03-9df2-4975-8e1c-9fef39059514 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d1eb89923784f1c83d2077c6b6926e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6e0eaf4eb48868a683c7769d3df7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:11.026429 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a88c2d03-9df2-4975-8e1c-9fef39059514 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 200 len: 1521 microversion: 2.1 time: 0.368750 Jul 25 16:30:11.027350 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 307/581] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:10 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:11.387238 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-e0318498-1699-4069-8706-3ece6439f4ec req-e4b92eff-a5f1-4cd5-ad9c-0441829cb22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c89d38b5-02b2-4e63-8dca-04b967a8cf14", "name": "network-vif-deleted", "tag": "bb0ff5b2-c268-4b5d-85a0-55179d065cdf"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:11.410518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e0318498-1699-4069-8706-3ece6439f4ec req-e4b92eff-a5f1-4cd5-ad9c-0441829cb22f service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:11.411064 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-e0318498-1699-4069-8706-3ece6439f4ec req-e4b92eff-a5f1-4cd5-ad9c-0441829cb22f service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:11.425975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-e0318498-1699-4069-8706-3ece6439f4ec req-e4b92eff-a5f1-4cd5-ad9c-0441829cb22f service nova] Creating event network-vif-deleted:bb0ff5b2-c268-4b5d-85a0-55179d065cdf for instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 on hv-cinder-83697 Jul 25 16:30:11.437444 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-e0318498-1699-4069-8706-3ece6439f4ec req-e4b92eff-a5f1-4cd5-ad9c-0441829cb22f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170582 Jul 25 16:30:11.444731 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 275/582] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:30:12.067889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:12.069247 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] [instance: c89d38b5-02b2-4e63-8dca-04b967a8cf14] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:12.082008 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:12.082766 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:12.084707 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:12.085248 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:12.114638 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] HTTP exception thrown: Instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 could not be found. Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Request method failure captured: Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 HTTP/1.1 Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sPKb9Fb-vH6xnT2mTjLGFd_QOBpmsX1Y8Rb9D03weDBhasNylRXYbFmkU2x6iERYZs7_9KM7dgcaOtpoTwNfAqLh_Na3tcjAOtL2BmuoAUQGulpjfzj19IPXftQo2eRfFhz3u8oML9jDvt8ZBdSwS3KFDldQI-3LKks8yVzk6uD41w Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:30:12.118014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/18b6e0eaf4eb48868a683c7769d3df7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_18b6e0eaf4eb48868a683c7769d3df7a"}]}] Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 18b6e0eaf4eb48868a683c7769d3df7a Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1183571930 Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 2d1eb89923784f1c83d2077c6b6926e9 Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1183571930-project Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 could not be found. Jul 25 16:30:12.119775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'c89d38b5-02b2-4e63-8dca-04b967a8cf14'} Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 could not be found. Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:12.120520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 could not be found. Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 could not be found. Jul 25 16:30:12.121896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:12.123036 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] Returning 404 to user: Instance c89d38b5-02b2-4e63-8dca-04b967a8cf14 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:12.123036 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0dd797eb-8e14-4042-a54c-293282f51b84 tempest-ServerRescueNegativeTestJSON-1183571930 tempest-ServerRescueNegativeTestJSON-1183571930-project] 10.222.0.66 "GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14" status: 404 len: 111 microversion: 2.1 time: 0.060583 Jul 25 16:30:12.123036 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 308/583] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:12 2022] GET /compute/v2.1/servers/c89d38b5-02b2-4e63-8dca-04b967a8cf14 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:30:12.236203 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea33d5c6-a6bc-4fc5-8268-91cc6e3fe6be tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:12.237084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea33d5c6-a6bc-4fc5-8268-91cc6e3fe6be tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:12.259083 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea33d5c6-a6bc-4fc5-8268-91cc6e3fe6be tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:12.262223 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea33d5c6-a6bc-4fc5-8268-91cc6e3fe6be tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:12.266426 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea33d5c6-a6bc-4fc5-8268-91cc6e3fe6be tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:12.269919 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea33d5c6-a6bc-4fc5-8268-91cc6e3fe6be tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:12.321924 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea33d5c6-a6bc-4fc5-8268-91cc6e3fe6be tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:30:12.452479 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea33d5c6-a6bc-4fc5-8268-91cc6e3fe6be tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "DELETE /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 204 len: 0 microversion: 2.1 time: 0.222627 Jul 25 16:30:12.453746 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 276/584] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:30:12 2022] DELETE /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:30:12.469309 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-842514ce-933a-4f53-a1eb-50fd77c7ed6e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:12.470779 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-842514ce-933a-4f53-a1eb-50fd77c7ed6e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:12.492953 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-842514ce-933a-4f53-a1eb-50fd77c7ed6e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:12.494121 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-842514ce-933a-4f53-a1eb-50fd77c7ed6e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:12.496042 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-842514ce-933a-4f53-a1eb-50fd77c7ed6e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:12.496828 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-842514ce-933a-4f53-a1eb-50fd77c7ed6e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:12.941748 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-842514ce-933a-4f53-a1eb-50fd77c7ed6e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:12.952154 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-842514ce-933a-4f53-a1eb-50fd77c7ed6e tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1554 microversion: 2.1 time: 0.492208 Jul 25 16:30:12.952912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 309/585] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:12 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1554 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:30:13.984352 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5505ea7d-e54f-48ba-bb89-f264f7d3d004 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:13.985529 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5505ea7d-e54f-48ba-bb89-f264f7d3d004 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:14.000549 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5505ea7d-e54f-48ba-bb89-f264f7d3d004 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:14.001168 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5505ea7d-e54f-48ba-bb89-f264f7d3d004 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:14.002481 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5505ea7d-e54f-48ba-bb89-f264f7d3d004 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:14.003187 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5505ea7d-e54f-48ba-bb89-f264f7d3d004 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:14.384876 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5505ea7d-e54f-48ba-bb89-f264f7d3d004 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:14.398685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5505ea7d-e54f-48ba-bb89-f264f7d3d004 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1554 microversion: 2.1 time: 0.422204 Jul 25 16:30:14.410231 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 277/586] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:13 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1554 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:15.424311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0d820ec1-bdf8-494f-98cf-02bb8221048c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:15.425093 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0d820ec1-bdf8-494f-98cf-02bb8221048c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:15.444681 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d820ec1-bdf8-494f-98cf-02bb8221048c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:15.445241 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d820ec1-bdf8-494f-98cf-02bb8221048c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:15.448699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d820ec1-bdf8-494f-98cf-02bb8221048c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:15.452908 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d820ec1-bdf8-494f-98cf-02bb8221048c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:15.613394 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0d820ec1-bdf8-494f-98cf-02bb8221048c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d7bbda47b64493a840fef8c6c40431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cf8bbbc4540a596f615498331465a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:15.630074 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0d820ec1-bdf8-494f-98cf-02bb8221048c tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 200 len: 1512 microversion: 2.1 time: 0.210362 Jul 25 16:30:15.630560 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 310/587] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:15 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:30:15.724805 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-41df336c-4755-4d94-b7c8-19e47eac6fdf req-b36e5523-d1ae-48eb-9801-d9ac73d04ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550fc385-910d-4a1a-8d15-13f92691d031", "name": "network-vif-deleted", "tag": "9a46516f-6426-4c10-a5d9-637e54e69b85"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:15.794697 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-41df336c-4755-4d94-b7c8-19e47eac6fdf req-b36e5523-d1ae-48eb-9801-d9ac73d04ead service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:15.798761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-41df336c-4755-4d94-b7c8-19e47eac6fdf req-b36e5523-d1ae-48eb-9801-d9ac73d04ead service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:15.828906 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-41df336c-4755-4d94-b7c8-19e47eac6fdf req-b36e5523-d1ae-48eb-9801-d9ac73d04ead service nova] Creating event network-vif-deleted:9a46516f-6426-4c10-a5d9-637e54e69b85 for instance 550fc385-910d-4a1a-8d15-13f92691d031 on hv-cinder-83697 Jul 25 16:30:15.837924 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-41df336c-4755-4d94-b7c8-19e47eac6fdf req-b36e5523-d1ae-48eb-9801-d9ac73d04ead service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135317 Jul 25 16:30:15.839372 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 278/588] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:16.671577 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:16.672467 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] [instance: 550fc385-910d-4a1a-8d15-13f92691d031] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:16.681966 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:16.683144 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:16.684268 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:16.684924 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:16.714066 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] HTTP exception thrown: Instance 550fc385-910d-4a1a-8d15-13f92691d031 could not be found. Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Request method failure captured: Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 HTTP/1.1 Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sRFh-q_1D5imChmCt91hbjxwg56sXeYmtRaTigu9Hm972Uh5CeBPjFSdSTA-eN6dc8ASmybPFZzfWfITUQOzyyyd353gBIef0lbdvuxhSlpN_vCO85hUZ1NnqdkXOkJn-sjJkIBp30r0wGZzYgw9lJEW0iaaSFmlam2XQWtv79T1C4 Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 966cf8bbbc4540a596f615498331465a Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestMinimumBasicScenario-104242772 Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:30:16.716461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/966cf8bbbc4540a596f615498331465a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/966cf8bbbc4540a596f615498331465a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/966cf8bbbc4540a596f615498331465a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_966cf8bbbc4540a596f615498331465a"}]}] Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestMinimumBasicScenario-104242772 Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 966cf8bbbc4540a596f615498331465a Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestMinimumBasicScenario-104242772 Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-TestMinimumBasicScenario-104242772-project Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 55d7bbda47b64493a840fef8c6c40431 Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestMinimumBasicScenario-104242772-project Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 550fc385-910d-4a1a-8d15-13f92691d031 could not be found. Jul 25 16:30:16.719318 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '550fc385-910d-4a1a-8d15-13f92691d031'} Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550fc385-910d-4a1a-8d15-13f92691d031 could not be found. Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:30:16.721440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550fc385-910d-4a1a-8d15-13f92691d031 could not be found. Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550fc385-910d-4a1a-8d15-13f92691d031 could not be found. Jul 25 16:30:16.724127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:30:16.729383 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Returning 404 to user: Instance 550fc385-910d-4a1a-8d15-13f92691d031 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:30:16.729383 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8e8bb782-1f4b-4c28-b58a-bc27f49b2b98 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031" status: 404 len: 111 microversion: 2.1 time: 0.063179 Jul 25 16:30:16.730264 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 311/589] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:30:16 2022] GET /compute/v2.1/servers/550fc385-910d-4a1a-8d15-13f92691d031 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:30:16.745908 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b2b5f692-18b7-4cd7-b9dc-4cc5743748d3 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] Calling method '.version_select at 0x7f440afdaaf0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:16.779714 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b2b5f692-18b7-4cd7-b9dc-4cc5743748d3 tempest-TestMinimumBasicScenario-104242772 tempest-TestMinimumBasicScenario-104242772-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1810918726" status: 202 len: 0 microversion: 2.1 time: 0.041341 Jul 25 16:30:16.780860 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 279/590] 10.222.0.66 () {58 vars in 1272 bytes} [Mon Jul 25 16:30:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1810918726 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:30:32.582793 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=11 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:32.584910 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:33.017778 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ccbf54ca-f4f3-4612-b6da-04f37c10cdee tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'create', calling method: .version_select at 0x7f440a707550>, body: {"keypair": {"name": "tempest-keypair-1809165704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKzTHfqjZbJ20+2Dyg1uZw+efHXl/RSea4EkBBejAjc3E3a5woA3KPrxE1hBmY3J7ArniCOGGANcpqpDfgrKdk89mjEwzCEFY3Jvi1bxW5yw6kMrBRd7IpaKB+lHJdkdw=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:33.080083 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-ccbf54ca-f4f3-4612-b6da-04f37c10cdee tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Getting quotas for project 4501489e56744cf98e49895b6d5aa6f8. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:33.086745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-ccbf54ca-f4f3-4612-b6da-04f37c10cdee tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Getting quotas for user 37e7fecdaae94842b6917152fb7f1598 and project 4501489e56744cf98e49895b6d5aa6f8. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:33.134784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ccbf54ca-f4f3-4612-b6da-04f37c10cdee tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.553859 Jul 25 16:30:33.137453 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 312/591] 10.222.0.66 () {62 vars in 1200 bytes} [Mon Jul 25 16:30:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 557 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 25 16:30:37.668680 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:37.672223 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:37.688204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-731024943", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70511969-6625-420f-86eb-299a6f40df62"}], "security_groups": [{"name": "tempest-securitygroup--1811940979"}], "key_name": "tempest-keypair-1809165704", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:38.006963 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] validate_networks() for [('70511969-6625-420f-86eb-299a6f40df62', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:30:38.995041 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:30:38.996944 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:30:38.997796 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:30:38.998457 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:30:38.999069 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:30:39.021912 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:39.022980 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:39.025140 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:39.026356 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:39.065731 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Getting quotas for project 4501489e56744cf98e49895b6d5aa6f8. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:39.076002 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Getting quotas for user 37e7fecdaae94842b6917152fb7f1598 and project 4501489e56744cf98e49895b6d5aa6f8. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:39.105133 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:30:39.111063 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:30:39.207383 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-16e020b6-6650-4de4-9d9f-2db0f20ee28e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.541805 Jul 25 16:30:39.213472 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 280/592] 10.222.0.66 () {62 vars in 1188 bytes} [Mon Jul 25 16:30:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 16:30:39.226980 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c4704d4d-e554-411c-896b-0f388fb1de72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:39.228437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c4704d4d-e554-411c-896b-0f388fb1de72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:39.365934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c4704d4d-e554-411c-896b-0f388fb1de72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:39.376206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c4704d4d-e554-411c-896b-0f388fb1de72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:39.378551 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c4704d4d-e554-411c-896b-0f388fb1de72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:39.381225 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c4704d4d-e554-411c-896b-0f388fb1de72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1281 microversion: 2.20 time: 0.159151 Jul 25 16:30:39.382267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 313/593] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:39 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:30:40.423205 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:40.424176 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:40.459946 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:40.465426 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:40.469997 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:40.471728 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:40.757388 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:40.782437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:40.787336 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:40.790340 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f5126822-8b76-4fbe-aa6f-a9b960a894e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1333 microversion: 2.20 time: 0.375115 Jul 25 16:30:40.792212 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 281/594] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:40 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1333 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:41.870735 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:41.874859 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:41.896101 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:41.897852 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:41.900368 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:41.905409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:42.088880 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-380a373b-556b-45df-955c-5c9dbc221524 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:42.094756 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-380a373b-556b-45df-955c-5c9dbc221524 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:42.121990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-380a373b-556b-45df-955c-5c9dbc221524 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:42.123157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-380a373b-556b-45df-955c-5c9dbc221524 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:42.125673 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-380a373b-556b-45df-955c-5c9dbc221524 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:42.126814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-380a373b-556b-45df-955c-5c9dbc221524 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:42.147717 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:42.180692 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:42.186631 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:42.191396 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b7320353-cb46-42fb-a233-7b7aada86def tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1339 microversion: 2.20 time: 0.342646 Jul 25 16:30:42.194996 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 314/595] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:41 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1339 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:42.244814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-380a373b-556b-45df-955c-5c9dbc221524 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/ips" status: 200 len: 144 microversion: 2.1 time: 0.164530 Jul 25 16:30:42.252194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 282/596] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:30:42 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/ips => generated 144 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:43.256353 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:43.258183 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:43.286662 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:43.287195 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:43.290678 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:43.296334 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:43.876568 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:43.907453 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:43.916300 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:43.925044 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-905d4e8a-78b3-4eb3-b063-28b0e146e26f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1407 microversion: 2.20 time: 0.686621 Jul 25 16:30:43.926552 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 315/597] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:43 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1407 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:44.462064 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0b4ce8ba-dd79-4830-bfee-dcb1e816da29 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0dcc8b6-17be-4eca-bed2-d679c6b0b6ae"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:44.466372 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0b4ce8ba-dd79-4830-bfee-dcb1e816da29 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:44.490200 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b4ce8ba-dd79-4830-bfee-dcb1e816da29 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:44.491540 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b4ce8ba-dd79-4830-bfee-dcb1e816da29 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:44.499446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b4ce8ba-dd79-4830-bfee-dcb1e816da29 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:44.502459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0b4ce8ba-dd79-4830-bfee-dcb1e816da29 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:44.973158 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:44.974114 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:45.013403 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:45.019129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:45.027279 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:45.028177 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:45.627311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0b4ce8ba-dd79-4830-bfee-dcb1e816da29 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.168171 Jul 25 16:30:45.636021 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 283/598] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:30:44 2022] POST /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments => generated 194 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:45.708341 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:45.751345 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:45.753603 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:45.754807 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5a4213b3-51f4-4a3f-9530-3dc4118d382b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1407 microversion: 2.20 time: 0.789280 Jul 25 16:30:45.755410 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 316/599] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:44 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1407 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:46.726964 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-bf60156d-f4b0-46b5-9826-b142c13cb4eb req-ff443c65-d607-4619-9b34-b46b4a3cfa15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f714dd8-86f9-4043-8bb6-39286efcfc1e", "tag": "67736d36-f7e4-45ee-9af7-218a816c87b0"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:46.780583 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bf60156d-f4b0-46b5-9826-b142c13cb4eb req-ff443c65-d607-4619-9b34-b46b4a3cfa15 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:46.782635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bf60156d-f4b0-46b5-9826-b142c13cb4eb req-ff443c65-d607-4619-9b34-b46b4a3cfa15 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:46.797085 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:46.798772 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:46.814428 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:46.816053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:46.818676 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:46.819593 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:46.824229 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-bf60156d-f4b0-46b5-9826-b142c13cb4eb req-ff443c65-d607-4619-9b34-b46b4a3cfa15 service nova] Creating event network-changed:67736d36-f7e4-45ee-9af7-218a816c87b0 for instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e on hv-cinder-83697 Jul 25 16:30:46.865313 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-bf60156d-f4b0-46b5-9826-b142c13cb4eb req-ff443c65-d607-4619-9b34-b46b4a3cfa15 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150805 Jul 25 16:30:46.869576 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 284/600] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:47.529772 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:47.553207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:47.559831 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:47.561308 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a444cc8f-3f81-4c5a-9cab-81f7f572e645 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1407 microversion: 2.20 time: 0.768579 Jul 25 16:30:47.562787 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 317/601] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:46 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1407 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:48.619288 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:48.622270 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:48.647843 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:48.651441 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:48.655986 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:48.657275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:48.885987 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:48.898505 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:48.901329 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:48.903102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1bb3c8f9-759e-4119-8890-b6669a7f06b3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1407 microversion: 2.20 time: 0.298392 Jul 25 16:30:48.904560 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 285/602] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:48 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1407 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:49.943662 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:49.945958 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:49.950895 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:49.962589 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:49.964783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:49.966746 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:49.967913 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:50.260248 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:50.281100 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:50.285323 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:50.288636 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a61a6dac-5e05-4194-813b-44e95b9711e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1407 microversion: 2.20 time: 0.352580 Jul 25 16:30:50.290667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 318/603] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:49 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:51.332268 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:51.334049 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:51.347027 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:51.348581 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:30:51.352605 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:51.353861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:51.355767 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:51.356997 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:51.732256 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:51.752241 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:51.767479 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:51.771538 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fe43153c-46df-41c7-9674-db82fadf223a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1407 microversion: 2.20 time: 0.446274 Jul 25 16:30:51.774011 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 286/604] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:51 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:52.632240 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-33b29efb-3760-4279-b7cc-cdd96cd03e95 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Action: 'create', calling method: .version_select at 0x7f440a665dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-241383450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1efp2NMu9/sxewCkjEVpBAX3JxGwDOfdg7ztNqFAtjvut5DT9THRZQA4JimEc1FhHKtlfCbvdVPtiiRydwYfHn+wEdHe6HmbqSrQnZrIskPr051PQxnFOVHJysv68LtA=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:52.660185 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-33b29efb-3760-4279-b7cc-cdd96cd03e95 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Getting quotas for project ee2c762eec4646afbd0ea4d71a58894d. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:30:52.667667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-33b29efb-3760-4279-b7cc-cdd96cd03e95 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Getting quotas for user d3eebc82ce654013998f58585c123a0e and project ee2c762eec4646afbd0ea4d71a58894d. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:30:52.721545 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-33b29efb-3760-4279-b7cc-cdd96cd03e95 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.434614 Jul 25 16:30:52.722243 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 319/605] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:30:52 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:52.811296 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:52.812147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:52.821821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:52.822834 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:52.824432 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:52.825113 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:53.083314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ad168b3e-8fc0-4cdc-a6b6-b260de32e6b8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:53.086815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ad168b3e-8fc0-4cdc-a6b6-b260de32e6b8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:53.099206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad168b3e-8fc0-4cdc-a6b6-b260de32e6b8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:53.099969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad168b3e-8fc0-4cdc-a6b6-b260de32e6b8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:53.101398 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad168b3e-8fc0-4cdc-a6b6-b260de32e6b8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:53.102271 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ad168b3e-8fc0-4cdc-a6b6-b260de32e6b8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:53.154482 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:53.170956 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:53.172194 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ad168b3e-8fc0-4cdc-a6b6-b260de32e6b8 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096592 Jul 25 16:30:53.172993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 320/606] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:30:53 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:30:53.177707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:53.177707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8cab7496-4001-46d0-9b1e-5f86a35ffb32 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1407 microversion: 2.20 time: 0.369488 Jul 25 16:30:53.177707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 287/607] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:52 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:30:53.189583 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6c809a39-7cb5-4759-a87d-78edae10c67f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:53.190692 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6c809a39-7cb5-4759-a87d-78edae10c67f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:53.202641 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c809a39-7cb5-4759-a87d-78edae10c67f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:53.203431 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c809a39-7cb5-4759-a87d-78edae10c67f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:53.204926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c809a39-7cb5-4759-a87d-78edae10c67f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:53.205796 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6c809a39-7cb5-4759-a87d-78edae10c67f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:53.258715 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6c809a39-7cb5-4759-a87d-78edae10c67f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/f0dcc8b6-17be-4eca-bed2-d679c6b0b6ae" status: 200 len: 194 microversion: 2.1 time: 0.076955 Jul 25 16:30:53.261431 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 288/608] 10.222.0.66 () {58 vars in 1413 bytes} [Mon Jul 25 16:30:53 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/f0dcc8b6-17be-4eca-bed2-d679c6b0b6ae => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:54.176379 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-2a808fad-42fd-4e4d-ab5c-6de66cbf0cc1 req-b682f7a4-1a6a-45c1-b505-7ca6b6b140c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714dd8-86f9-4043-8bb6-39286efcfc1e", "name": "network-vif-plugged", "status": "completed", "tag": "67736d36-f7e4-45ee-9af7-218a816c87b0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:54.205437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:54.206309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:54.226178 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-2a808fad-42fd-4e4d-ab5c-6de66cbf0cc1 req-b682f7a4-1a6a-45c1-b505-7ca6b6b140c1 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:54.228994 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:54.230005 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-2a808fad-42fd-4e4d-ab5c-6de66cbf0cc1 req-b682f7a4-1a6a-45c1-b505-7ca6b6b140c1 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:54.230859 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:54.233250 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:54.236880 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:54.261597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-2a808fad-42fd-4e4d-ab5c-6de66cbf0cc1 req-b682f7a4-1a6a-45c1-b505-7ca6b6b140c1 service nova] Creating event network-vif-plugged:67736d36-f7e4-45ee-9af7-218a816c87b0 for instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e on hv-cinder-83697 Jul 25 16:30:54.275258 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-2a808fad-42fd-4e4d-ab5c-6de66cbf0cc1 req-b682f7a4-1a6a-45c1-b505-7ca6b6b140c1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260127 Jul 25 16:30:54.276599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 321/609] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:30:54.505769 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:54.539180 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:54.542501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:54.544702 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b4ad296e-aff8-4d31-a43b-db6634178d77 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1407 microversion: 2.20 time: 0.344626 Jul 25 16:30:54.546207 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 289/610] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:54 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:54.983469 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1475a296-38d4-47ec-8a9b-057d6d970711 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1224b42d-a56a-426d-97f0-ebc61a9a7e17"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:54.986709 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1475a296-38d4-47ec-8a9b-057d6d970711 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:54.997418 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1475a296-38d4-47ec-8a9b-057d6d970711 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:54.998285 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1475a296-38d4-47ec-8a9b-057d6d970711 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:54.999301 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1475a296-38d4-47ec-8a9b-057d6d970711 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:55.000125 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1475a296-38d4-47ec-8a9b-057d6d970711 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:55.595343 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:55.596809 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:55.643376 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:55.644138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:55.681716 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:55.690677 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:55.709653 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1475a296-38d4-47ec-8a9b-057d6d970711 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "POST /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735516 Jul 25 16:30:55.723826 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 322/611] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:30:54 2022] POST /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:30:56.074851 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:56.131290 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:56.143305 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:56.145939 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a12ce4b2-11b1-439c-83c3-af7e1ae0cf40 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1407 microversion: 2.20 time: 0.561235 Jul 25 16:30:56.154004 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 290/612] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:55 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:30:57.183029 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:57.184062 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:57.196437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:57.197218 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:57.198818 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:57.199701 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:57.454874 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:57.472969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:57.476270 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:30:57.479440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-18c8db9b-190a-4612-b042-2c83a4207834 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1598 microversion: 2.20 time: 0.301862 Jul 25 16:30:57.481131 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 323/613] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:30:57 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1598 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:30:57.512904 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c2137ba4-e1f2-476f-9a4f-ef9c8c1ba8d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:30:57.514493 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c2137ba4-e1f2-476f-9a4f-ef9c8c1ba8d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:30:57.526324 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2137ba4-e1f2-476f-9a4f-ef9c8c1ba8d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:57.527144 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2137ba4-e1f2-476f-9a4f-ef9c8c1ba8d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:57.528316 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2137ba4-e1f2-476f-9a4f-ef9c8c1ba8d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:57.529057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2137ba4-e1f2-476f-9a4f-ef9c8c1ba8d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:57.681134 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c2137ba4-e1f2-476f-9a4f-ef9c8c1ba8d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.175884 Jul 25 16:30:57.683377 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 291/614] 10.222.0.66 () {60 vars in 1316 bytes} [Mon Jul 25 16:30:57 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:30:59.823439 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-03aeac8d-0992-4a8c-8f06-57c074c9024d req-d124918e-bfb1-4bdf-bfd2-fbb4e802e2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f714dd8-86f9-4043-8bb6-39286efcfc1e", "tag": "67736d36-f7e4-45ee-9af7-218a816c87b0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:30:59.842963 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-03aeac8d-0992-4a8c-8f06-57c074c9024d req-d124918e-bfb1-4bdf-bfd2-fbb4e802e2b8 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:30:59.843920 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-03aeac8d-0992-4a8c-8f06-57c074c9024d req-d124918e-bfb1-4bdf-bfd2-fbb4e802e2b8 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:30:59.867495 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-03aeac8d-0992-4a8c-8f06-57c074c9024d req-d124918e-bfb1-4bdf-bfd2-fbb4e802e2b8 service nova] Creating event network-changed:67736d36-f7e4-45ee-9af7-218a816c87b0 for instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e on hv-cinder-83697 Jul 25 16:30:59.879175 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-03aeac8d-0992-4a8c-8f06-57c074c9024d req-d124918e-bfb1-4bdf-bfd2-fbb4e802e2b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061918 Jul 25 16:30:59.880344 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 324/615] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:03.795759 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a26013b5-71de-4cb5-8165-8f12bdc4909d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:03.799850 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a26013b5-71de-4cb5-8165-8f12bdc4909d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:03.811762 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a26013b5-71de-4cb5-8165-8f12bdc4909d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:03.812543 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a26013b5-71de-4cb5-8165-8f12bdc4909d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:03.814139 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a26013b5-71de-4cb5-8165-8f12bdc4909d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:03.815052 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a26013b5-71de-4cb5-8165-8f12bdc4909d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:03.881635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a26013b5-71de-4cb5-8165-8f12bdc4909d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.096127 Jul 25 16:31:03.882630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 292/616] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:31:03 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments => generated 371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:04.027981 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:04.036465 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-32b388a5-c3a9-4237-afc9-61f3c645f105 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:04.037526 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-32b388a5-c3a9-4237-afc9-61f3c645f105 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:04.040934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:04.051474 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32b388a5-c3a9-4237-afc9-61f3c645f105 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:04.052247 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32b388a5-c3a9-4237-afc9-61f3c645f105 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:04.053757 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32b388a5-c3a9-4237-afc9-61f3c645f105 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:04.054539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-32b388a5-c3a9-4237-afc9-61f3c645f105 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:04.063716 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:04.117168 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-32b388a5-c3a9-4237-afc9-61f3c645f105 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/f0dcc8b6-17be-4eca-bed2-d679c6b0b6ae" status: 200 len: 194 microversion: 2.1 time: 0.091490 Jul 25 16:31:04.118312 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 325/617] 10.222.0.66 () {58 vars in 1413 bytes} [Mon Jul 25 16:31:04 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/f0dcc8b6-17be-4eca-bed2-d679c6b0b6ae => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:04.138799 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-65f46479-e4bc-4ae4-87d6-f05cbf78f57d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:04.139238 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-65f46479-e4bc-4ae4-87d6-f05cbf78f57d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:04.151233 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65f46479-e4bc-4ae4-87d6-f05cbf78f57d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:04.152011 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65f46479-e4bc-4ae4-87d6-f05cbf78f57d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:04.153654 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65f46479-e4bc-4ae4-87d6-f05cbf78f57d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:04.154443 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-65f46479-e4bc-4ae4-87d6-f05cbf78f57d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:04.309872 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-65f46479-e4bc-4ae4-87d6-f05cbf78f57d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lazy-loading 'services' on Instance uuid 14ac90f4-881f-449c-831f-30d2a1da6918 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:31:04.444062 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-65f46479-e4bc-4ae4-87d6-f05cbf78f57d tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "DELETE /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/f0dcc8b6-17be-4eca-bed2-d679c6b0b6ae" status: 202 len: 0 microversion: 2.1 time: 0.313397 Jul 25 16:31:04.445220 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 293/618] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:31:04 2022] DELETE /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/f0dcc8b6-17be-4eca-bed2-d679c6b0b6ae => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:31:05.681466 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4f49d57-91be-4d75-ac06-ad8ecd9af4cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:05.682344 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4f49d57-91be-4d75-ac06-ad8ecd9af4cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:05.691330 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4f49d57-91be-4d75-ac06-ad8ecd9af4cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:05.692434 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4f49d57-91be-4d75-ac06-ad8ecd9af4cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:05.693691 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4f49d57-91be-4d75-ac06-ad8ecd9af4cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:05.694358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4f49d57-91be-4d75-ac06-ad8ecd9af4cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:05.761442 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4f49d57-91be-4d75-ac06-ad8ecd9af4cc tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/1224b42d-a56a-426d-97f0-ebc61a9a7e17" status: 200 len: 194 microversion: 2.1 time: 0.084646 Jul 25 16:31:05.762574 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 326/619] 10.222.0.66 () {58 vars in 1413 bytes} [Mon Jul 25 16:31:05 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/1224b42d-a56a-426d-97f0-ebc61a9a7e17 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:05.778623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3ba4aa55-e51e-49dd-b83e-3b724d48ed5c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:05.779482 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3ba4aa55-e51e-49dd-b83e-3b724d48ed5c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:05.787127 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ba4aa55-e51e-49dd-b83e-3b724d48ed5c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:05.787563 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ba4aa55-e51e-49dd-b83e-3b724d48ed5c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:05.788349 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ba4aa55-e51e-49dd-b83e-3b724d48ed5c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:05.788771 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ba4aa55-e51e-49dd-b83e-3b724d48ed5c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:05.905226 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-3ba4aa55-e51e-49dd-b83e-3b724d48ed5c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lazy-loading 'services' on Instance uuid 14ac90f4-881f-449c-831f-30d2a1da6918 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:31:06.033646 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3ba4aa55-e51e-49dd-b83e-3b724d48ed5c tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "DELETE /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/1224b42d-a56a-426d-97f0-ebc61a9a7e17" status: 202 len: 0 microversion: 2.1 time: 0.259943 Jul 25 16:31:06.034355 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 294/620] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:31:05 2022] DELETE /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments/1224b42d-a56a-426d-97f0-ebc61a9a7e17 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:31:07.262914 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-27edc95b-f7a9-4b61-bb96-1789e4ac744f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:07.265514 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-27edc95b-f7a9-4b61-bb96-1789e4ac744f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:07.278579 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27edc95b-f7a9-4b61-bb96-1789e4ac744f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.279351 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27edc95b-f7a9-4b61-bb96-1789e4ac744f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27edc95b-f7a9-4b61-bb96-1789e4ac744f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.281634 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27edc95b-f7a9-4b61-bb96-1789e4ac744f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.340521 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-27edc95b-f7a9-4b61-bb96-1789e4ac744f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081463 Jul 25 16:31:07.341612 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 327/621] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:31:07 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 16:31:07.532499 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2c52783-02d2-40b3-8f17-a7db65dbe890 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:07.536868 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2c52783-02d2-40b3-8f17-a7db65dbe890 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:07.549776 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2c52783-02d2-40b3-8f17-a7db65dbe890 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.550792 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2c52783-02d2-40b3-8f17-a7db65dbe890 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.552282 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2c52783-02d2-40b3-8f17-a7db65dbe890 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.553111 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2c52783-02d2-40b3-8f17-a7db65dbe890 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.605627 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:07.614787 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2c52783-02d2-40b3-8f17-a7db65dbe890 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090685 Jul 25 16:31:07.615498 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 295/622] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:31:07 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:31:07.717702 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5ffe46a4-892e-4a45-a141-39e471019a14 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:07.718396 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5ffe46a4-892e-4a45-a141-39e471019a14 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:07.729877 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffe46a4-892e-4a45-a141-39e471019a14 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.730624 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffe46a4-892e-4a45-a141-39e471019a14 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.732088 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffe46a4-892e-4a45-a141-39e471019a14 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.732839 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ffe46a4-892e-4a45-a141-39e471019a14 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.782562 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5ffe46a4-892e-4a45-a141-39e471019a14 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:31:07.914166 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5ffe46a4-892e-4a45-a141-39e471019a14 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "DELETE /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 204 len: 0 microversion: 2.1 time: 0.201147 Jul 25 16:31:07.915095 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 328/623] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:31:07 2022] DELETE /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:31:07.932619 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f909b51f-1b3e-4254-a93a-0665c1646a60 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:07.934144 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f909b51f-1b3e-4254-a93a-0665c1646a60 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:07.937374 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:07.944817 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f909b51f-1b3e-4254-a93a-0665c1646a60 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.950629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f909b51f-1b3e-4254-a93a-0665c1646a60 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:07.950629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f909b51f-1b3e-4254-a93a-0665c1646a60 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:07.950629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f909b51f-1b3e-4254-a93a-0665c1646a60 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:08.146737 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f909b51f-1b3e-4254-a93a-0665c1646a60 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:08.159316 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f909b51f-1b3e-4254-a93a-0665c1646a60 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1672 microversion: 2.1 time: 0.235680 Jul 25 16:31:08.160371 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 296/624] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:07 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:09.193910 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-27fce340-8ab9-4fb3-8d28-57cc23dc1175 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:09.194602 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-27fce340-8ab9-4fb3-8d28-57cc23dc1175 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:09.202325 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27fce340-8ab9-4fb3-8d28-57cc23dc1175 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:09.202768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27fce340-8ab9-4fb3-8d28-57cc23dc1175 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:09.203591 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27fce340-8ab9-4fb3-8d28-57cc23dc1175 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:09.204024 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-27fce340-8ab9-4fb3-8d28-57cc23dc1175 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:09.366884 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-27fce340-8ab9-4fb3-8d28-57cc23dc1175 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:09.375648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-27fce340-8ab9-4fb3-8d28-57cc23dc1175 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1672 microversion: 2.1 time: 0.186329 Jul 25 16:31:09.376259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 329/625] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:09 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:10.308845 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1419033929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241383450", "security_groups": [{"name": "tempest-secgroup-smoke-487919838"}], "block_device_mapping_v2": [{"uuid": "ccfafa25-b3c4-475c-aac4-499a3c5370fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5179c8ca-857c-4cbe-a31d-a95e81512509"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:10.404970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5f556735-f3c6-42dc-a04e-e38c243d7cf9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:10.407131 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5f556735-f3c6-42dc-a04e-e38c243d7cf9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:10.419734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f556735-f3c6-42dc-a04e-e38c243d7cf9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:10.420536 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f556735-f3c6-42dc-a04e-e38c243d7cf9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:10.422069 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f556735-f3c6-42dc-a04e-e38c243d7cf9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:10.422867 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5f556735-f3c6-42dc-a04e-e38c243d7cf9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:10.534646 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] validate_networks() for [('5179c8ca-857c-4cbe-a31d-a95e81512509', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:31:10.734074 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5f556735-f3c6-42dc-a04e-e38c243d7cf9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:10.749398 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5f556735-f3c6-42dc-a04e-e38c243d7cf9 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1672 microversion: 2.1 time: 0.351839 Jul 25 16:31:10.761635 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 330/626] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:10 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1672 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:11.175895 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:31:11.176395 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:31:11.176928 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:31:11.177455 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:31:11.177841 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:31:11.189850 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.190291 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:11.191310 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.191736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:11.211468 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Getting quotas for project ee2c762eec4646afbd0ea4d71a58894d. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:31:11.216949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Getting quotas for user d3eebc82ce654013998f58585c123a0e and project ee2c762eec4646afbd0ea4d71a58894d. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:31:11.288871 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:31:11.291826 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccfafa25-b3c4-475c-aac4-499a3c5370fb',volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:31:11.451853 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-414792ee-9e8d-46a4-9dc6-7dba136d7463 req-b18d4582-339b-43c8-b53f-d00c633d6113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14ac90f4-881f-449c-831f-30d2a1da6918", "name": "network-vif-deleted", "tag": "bb374d5e-fe9e-4511-9e53-90ae0fd8e672"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:11.466392 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-414792ee-9e8d-46a4-9dc6-7dba136d7463 req-b18d4582-339b-43c8-b53f-d00c633d6113 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.467192 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-414792ee-9e8d-46a4-9dc6-7dba136d7463 req-b18d4582-339b-43c8-b53f-d00c633d6113 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:11.494009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-414792ee-9e8d-46a4-9dc6-7dba136d7463 req-b18d4582-339b-43c8-b53f-d00c633d6113 service nova] Creating event network-vif-deleted:bb374d5e-fe9e-4511-9e53-90ae0fd8e672 for instance 14ac90f4-881f-449c-831f-30d2a1da6918 on hv-cinder-83697 Jul 25 16:31:11.509360 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-414792ee-9e8d-46a4-9dc6-7dba136d7463 req-b18d4582-339b-43c8-b53f-d00c633d6113 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060607 Jul 25 16:31:11.511195 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 331/627] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:31:11.613147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b28a0d29-0ed9-4dbc-82a2-0f6f0aa1de54 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.316252 Jul 25 16:31:11.614935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 297/628] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:31:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:31:11.637709 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bc13015b-4dfe-4bc5-bf70-2b967c60f810 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:11.639001 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bc13015b-4dfe-4bc5-bf70-2b967c60f810 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:11.769541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bc13015b-4dfe-4bc5-bf70-2b967c60f810 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:11.786496 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bc13015b-4dfe-4bc5-bf70-2b967c60f810 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1094 microversion: 2.1 time: 0.157705 Jul 25 16:31:11.788091 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 332/629] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:11 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1094 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:11.802325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:11.805403 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:11.816241 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.816967 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:11.818004 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.818776 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:11.883154 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:11.883940 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:11.884748 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lazy-loading 'fault' on Instance uuid 14ac90f4-881f-449c-831f-30d2a1da6918 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:31:11.960343 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644c0a532fa747c7abf4d53759e89181', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c4be8083168475198c66cca890b18a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:11.984934 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cf9ab0f4-ff97-4a12-a653-4ddd640f2998 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 200 len: 1328 microversion: 2.1 time: 0.204960 Jul 25 16:31:12.006916 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 298/630] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:11 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 1328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:12.824932 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-21135a09-c8df-4a26-9acf-c44f6d7c751e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:12.826132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-21135a09-c8df-4a26-9acf-c44f6d7c751e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:12.837273 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21135a09-c8df-4a26-9acf-c44f6d7c751e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:12.838047 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21135a09-c8df-4a26-9acf-c44f6d7c751e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:12.839464 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21135a09-c8df-4a26-9acf-c44f6d7c751e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:12.840213 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-21135a09-c8df-4a26-9acf-c44f6d7c751e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:12.939630 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-21135a09-c8df-4a26-9acf-c44f6d7c751e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:12.952019 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-21135a09-c8df-4a26-9acf-c44f6d7c751e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1192 microversion: 2.1 time: 0.132792 Jul 25 16:31:12.953145 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 333/631] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:12 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1192 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:13.039701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:13.044994 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:13.062433 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:13.064128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:13.066787 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:13.070627 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:13.110935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] HTTP exception thrown: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Request method failure captured: Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 HTTP/1.1 Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sPGSryRSVQAbbL4_p3DSgGFH0zVMx8Yy-OgvSZsanbr2j6TB9EMmO3KM5oh9iG4CVueXCaEoHiYLuH8rCoVHTOr2fAQ4gOMdLAAGxAAaptEkpMbLjyy2jumiwnoVEZess8TI64M2reIRuKRE8C6xkoOBB_b5_L2Fg9D_rNbPXi6cdA Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:31:13.118445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c4be8083168475198c66cca890b18a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c4be8083168475198c66cca890b18a9"}]}] Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 644c0a532fa747c7abf4d53759e89181 Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:13.121785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '14ac90f4-881f-449c-831f-30d2a1da6918'} Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:31:13.123412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:13.127669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:13.133106 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Returning 404 to user: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:31:13.133106 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9aeccc13-bfe8-44dc-92f7-11a8b8a61375 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 404 len: 111 microversion: 2.1 time: 0.101841 Jul 25 16:31:13.133106 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 299/632] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:13 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:31:13.146746 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bd707a24-ab2e-4129-9669-0976bdeef588 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '.version_select at 0x7f440a7073a0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:13.183688 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bd707a24-ab2e-4129-9669-0976bdeef588 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902897875" status: 202 len: 0 microversion: 2.1 time: 0.044917 Jul 25 16:31:13.184907 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 334/633] 10.222.0.66 () {58 vars in 1221 bytes} [Mon Jul 25 16:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902897875 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:31:13.990421 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ac1e23b2-d712-4ffd-8a6b-213e42300b4d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:13.991189 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ac1e23b2-d712-4ffd-8a6b-213e42300b4d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:13.998200 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac1e23b2-d712-4ffd-8a6b-213e42300b4d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:13.998778 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac1e23b2-d712-4ffd-8a6b-213e42300b4d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:13.999863 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac1e23b2-d712-4ffd-8a6b-213e42300b4d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:14.000414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ac1e23b2-d712-4ffd-8a6b-213e42300b4d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:14.095139 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ac1e23b2-d712-4ffd-8a6b-213e42300b4d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:14.108981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ac1e23b2-d712-4ffd-8a6b-213e42300b4d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1198 microversion: 2.1 time: 0.122834 Jul 25 16:31:14.110123 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 300/634] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:13 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:15.149481 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ea817fb0-0282-4d80-9963-402ce90c6095 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:15.151735 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ea817fb0-0282-4d80-9963-402ce90c6095 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:15.162911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea817fb0-0282-4d80-9963-402ce90c6095 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:15.164074 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea817fb0-0282-4d80-9963-402ce90c6095 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:15.165816 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea817fb0-0282-4d80-9963-402ce90c6095 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:15.167049 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea817fb0-0282-4d80-9963-402ce90c6095 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:15.387925 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ea817fb0-0282-4d80-9963-402ce90c6095 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:15.403297 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ea817fb0-0282-4d80-9963-402ce90c6095 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.262464 Jul 25 16:31:15.404661 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 335/635] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:15 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:15.518090 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c9e27ac9-304b-4e17-a18a-4867c97c0321 req-b2703426-2e0a-41c4-ab45-63e218a460df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8757e6e3-9388-4e11-9060-a1e8b7e2192a", "tag": "ba67a122-49be-4a38-b52a-c75066e7b265"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:15.561056 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c9e27ac9-304b-4e17-a18a-4867c97c0321 req-b2703426-2e0a-41c4-ab45-63e218a460df service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:15.561772 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c9e27ac9-304b-4e17-a18a-4867c97c0321 req-b2703426-2e0a-41c4-ab45-63e218a460df service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:15.592269 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c9e27ac9-304b-4e17-a18a-4867c97c0321 req-b2703426-2e0a-41c4-ab45-63e218a460df service nova] Creating event network-changed:ba67a122-49be-4a38-b52a-c75066e7b265 for instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a on hv-cinder-83697 Jul 25 16:31:15.599780 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c9e27ac9-304b-4e17-a18a-4867c97c0321 req-b2703426-2e0a-41c4-ab45-63e218a460df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089281 Jul 25 16:31:15.600415 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 301/636] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:16.446846 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1780851c-6a5b-41bc-afe0-7d14d36db8f6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:16.448087 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1780851c-6a5b-41bc-afe0-7d14d36db8f6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:16.458235 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1780851c-6a5b-41bc-afe0-7d14d36db8f6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:16.458819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1780851c-6a5b-41bc-afe0-7d14d36db8f6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:16.459881 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1780851c-6a5b-41bc-afe0-7d14d36db8f6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:16.460895 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1780851c-6a5b-41bc-afe0-7d14d36db8f6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:16.677138 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1780851c-6a5b-41bc-afe0-7d14d36db8f6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:16.693794 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1780851c-6a5b-41bc-afe0-7d14d36db8f6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.251669 Jul 25 16:31:16.694828 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 336/637] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:16 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:17.028561 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:17.029543 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:17.040006 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.040936 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:17.042101 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.042794 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:17.063982 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] HTTP exception thrown: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Request method failure captured: Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 HTTP/1.1 Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sPGSryRSVQAbbL4_p3DSgGFH0zVMx8Yy-OgvSZsanbr2j6TB9EMmO3KM5oh9iG4CVueXCaEoHiYLuH8rCoVHTOr2fAQ4gOMdLAAGxAAaptEkpMbLjyy2jumiwnoVEZess8TI64M2reIRuKRE8C6xkoOBB_b5_L2Fg9D_rNbPXi6cdA Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:31:17.066155 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c4be8083168475198c66cca890b18a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c4be8083168475198c66cca890b18a9"}]}] Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 644c0a532fa747c7abf4d53759e89181 Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.068977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '14ac90f4-881f-449c-831f-30d2a1da6918'} Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:31:17.070536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.073157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.075929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Returning 404 to user: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:31:17.075929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c1de2bb2-aa74-43b8-af55-01588031996f tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "DELETE /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 404 len: 111 microversion: 2.1 time: 0.048011 Jul 25 16:31:17.075929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 302/638] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:31:17 2022] DELETE /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:31:17.085737 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:17.086785 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: 14ac90f4-881f-449c-831f-30d2a1da6918] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:17.099183 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.100260 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:17.102647 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.103439 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:17.136067 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] HTTP exception thrown: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Request method failure captured: Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 HTTP/1.1 Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sPGSryRSVQAbbL4_p3DSgGFH0zVMx8Yy-OgvSZsanbr2j6TB9EMmO3KM5oh9iG4CVueXCaEoHiYLuH8rCoVHTOr2fAQ4gOMdLAAGxAAaptEkpMbLjyy2jumiwnoVEZess8TI64M2reIRuKRE8C6xkoOBB_b5_L2Fg9D_rNbPXi6cdA Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:31:17.139523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c4be8083168475198c66cca890b18a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c4be8083168475198c66cca890b18a9"}]}] Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 644c0a532fa747c7abf4d53759e89181 Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.142251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '14ac90f4-881f-449c-831f-30d2a1da6918'} Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:31:17.143594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. Jul 25 16:31:17.145007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:17.146400 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Returning 404 to user: Instance 14ac90f4-881f-449c-831f-30d2a1da6918 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:31:17.146400 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a062c722-09b5-4d6e-9772-d0be401b4484 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918" status: 404 len: 111 microversion: 2.1 time: 0.063894 Jul 25 16:31:17.146400 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 337/639] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:17 2022] GET /compute/v2.1/servers/14ac90f4-881f-449c-831f-30d2a1da6918 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:31:17.721491 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2971f258-fe67-40be-b409-107a23800914 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:17.722154 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2971f258-fe67-40be-b409-107a23800914 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:17.730953 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2971f258-fe67-40be-b409-107a23800914 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.731414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2971f258-fe67-40be-b409-107a23800914 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:17.732257 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2971f258-fe67-40be-b409-107a23800914 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:17.732687 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2971f258-fe67-40be-b409-107a23800914 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:17.929390 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2971f258-fe67-40be-b409-107a23800914 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:17.938359 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2971f258-fe67-40be-b409-107a23800914 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.222185 Jul 25 16:31:17.939104 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 303/640] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:17 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:18.359401 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:18.360298 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:18.368672 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:18.369171 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:18.370087 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:18.370559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:18.387712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] HTTP exception thrown: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Request method failure captured: Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 HTTP/1.1 Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sPGSryRSVQAbbL4_p3DSgGFH0zVMx8Yy-OgvSZsanbr2j6TB9EMmO3KM5oh9iG4CVueXCaEoHiYLuH8rCoVHTOr2fAQ4gOMdLAAGxAAaptEkpMbLjyy2jumiwnoVEZess8TI64M2reIRuKRE8C6xkoOBB_b5_L2Fg9D_rNbPXi6cdA Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:31:18.389457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c4be8083168475198c66cca890b18a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c4be8083168475198c66cca890b18a9"}]}] Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 644c0a532fa747c7abf4d53759e89181 Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.392221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'bfffb541-3a46-4a3f-ad6c-8d7a88586b23'} Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:31:18.393822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.396198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.398715 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Returning 404 to user: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:31:18.398715 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-09e1e87d-d1f7-45f8-9d73-abbb57365d85 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 404 len: 111 microversion: 2.1 time: 0.035809 Jul 25 16:31:18.398715 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 338/641] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:31:18 2022] DELETE /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:31:18.400617 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:18.401418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] [instance: bfffb541-3a46-4a3f-ad6c-8d7a88586b23] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:18.409300 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:18.409777 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:18.410563 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:18.411013 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:18.431142 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] HTTP exception thrown: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Request method failure captured: Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 HTTP/1.1 Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sPGSryRSVQAbbL4_p3DSgGFH0zVMx8Yy-OgvSZsanbr2j6TB9EMmO3KM5oh9iG4CVueXCaEoHiYLuH8rCoVHTOr2fAQ4gOMdLAAGxAAaptEkpMbLjyy2jumiwnoVEZess8TI64M2reIRuKRE8C6xkoOBB_b5_L2Fg9D_rNbPXi6cdA Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:31:18.434391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5c4be8083168475198c66cca890b18a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5c4be8083168475198c66cca890b18a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5c4be8083168475198c66cca890b18a9"}]}] Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 5c4be8083168475198c66cca890b18a9 Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeTestJSON-361562925 Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 644c0a532fa747c7abf4d53759e89181 Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeTestJSON-361562925-project Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.438248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'bfffb541-3a46-4a3f-ad6c-8d7a88586b23'} Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:31:18.439784 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. Jul 25 16:31:18.449751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:31:18.453115 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] Returning 404 to user: Instance bfffb541-3a46-4a3f-ad6c-8d7a88586b23 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:31:18.453115 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5fcc0e6b-5f38-4af5-9677-083a2f66fdf3 tempest-AttachVolumeTestJSON-361562925 tempest-AttachVolumeTestJSON-361562925-project] 10.222.0.66 "GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23" status: 404 len: 111 microversion: 2.1 time: 0.039909 Jul 25 16:31:18.453115 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 304/642] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:18 2022] GET /compute/v2.1/servers/bfffb541-3a46-4a3f-ad6c-8d7a88586b23 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:31:18.965282 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ac5bd33-793b-4f8d-b5b6-094b4d8cff29 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:18.966407 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2ac5bd33-793b-4f8d-b5b6-094b4d8cff29 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:18.978339 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ac5bd33-793b-4f8d-b5b6-094b4d8cff29 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:18.979170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ac5bd33-793b-4f8d-b5b6-094b4d8cff29 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:18.980665 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ac5bd33-793b-4f8d-b5b6-094b4d8cff29 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:18.981486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ac5bd33-793b-4f8d-b5b6-094b4d8cff29 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:19.446918 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2ac5bd33-793b-4f8d-b5b6-094b4d8cff29 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:19.460488 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2ac5bd33-793b-4f8d-b5b6-094b4d8cff29 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.502412 Jul 25 16:31:19.461557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 339/643] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:18 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:20.501828 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-22b1bf9c-c0f4-45e9-9f71-f511240752ca tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:20.503013 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-22b1bf9c-c0f4-45e9-9f71-f511240752ca tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:20.515034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22b1bf9c-c0f4-45e9-9f71-f511240752ca tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:20.515826 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22b1bf9c-c0f4-45e9-9f71-f511240752ca tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:20.517735 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22b1bf9c-c0f4-45e9-9f71-f511240752ca tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:20.518487 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-22b1bf9c-c0f4-45e9-9f71-f511240752ca tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:20.870893 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-22b1bf9c-c0f4-45e9-9f71-f511240752ca tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:20.884900 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-22b1bf9c-c0f4-45e9-9f71-f511240752ca tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.391948 Jul 25 16:31:20.886456 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 305/644] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:20 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:21.921765 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4eae250e-39b7-40fb-9d55-85d1bb41b429 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:21.922427 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4eae250e-39b7-40fb-9d55-85d1bb41b429 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:21.925205 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:21.931957 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eae250e-39b7-40fb-9d55-85d1bb41b429 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:21.932441 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eae250e-39b7-40fb-9d55-85d1bb41b429 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:21.933280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eae250e-39b7-40fb-9d55-85d1bb41b429 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:21.933853 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4eae250e-39b7-40fb-9d55-85d1bb41b429 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:22.441383 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4eae250e-39b7-40fb-9d55-85d1bb41b429 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:22.454041 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4eae250e-39b7-40fb-9d55-85d1bb41b429 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.535718 Jul 25 16:31:22.455466 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 340/645] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:21 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:23.478779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-baeca606-d617-429d-9021-b324527430fb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:23.479710 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-baeca606-d617-429d-9021-b324527430fb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:23.481957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:23.483183 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:23.492755 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baeca606-d617-429d-9021-b324527430fb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:23.493562 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baeca606-d617-429d-9021-b324527430fb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:23.494592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baeca606-d617-429d-9021-b324527430fb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:23.495308 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-baeca606-d617-429d-9021-b324527430fb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:23.816528 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-baeca606-d617-429d-9021-b324527430fb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:23.832862 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-baeca606-d617-429d-9021-b324527430fb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.357901 Jul 25 16:31:23.834483 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 306/646] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:23 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:24.871250 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8e83d12f-7ec2-4125-963c-752444af689c tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:24.872513 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8e83d12f-7ec2-4125-963c-752444af689c tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:24.882090 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e83d12f-7ec2-4125-963c-752444af689c tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:24.882783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e83d12f-7ec2-4125-963c-752444af689c tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:24.883808 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e83d12f-7ec2-4125-963c-752444af689c tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:24.884401 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e83d12f-7ec2-4125-963c-752444af689c tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:25.083188 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8e83d12f-7ec2-4125-963c-752444af689c tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:25.096595 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8e83d12f-7ec2-4125-963c-752444af689c tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.232360 Jul 25 16:31:25.097639 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 341/647] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:24 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:25.910869 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-9902b5b5-560b-41d0-a2c3-d99085114b44 req-96a3c41d-2214-40a7-9df4-0736217e0b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8757e6e3-9388-4e11-9060-a1e8b7e2192a", "name": "network-vif-plugged", "status": "completed", "tag": "ba67a122-49be-4a38-b52a-c75066e7b265"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:25.933562 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9902b5b5-560b-41d0-a2c3-d99085114b44 req-96a3c41d-2214-40a7-9df4-0736217e0b87 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:25.934078 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-9902b5b5-560b-41d0-a2c3-d99085114b44 req-96a3c41d-2214-40a7-9df4-0736217e0b87 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:25.957461 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-9902b5b5-560b-41d0-a2c3-d99085114b44 req-96a3c41d-2214-40a7-9df4-0736217e0b87 service nova] Creating event network-vif-plugged:ba67a122-49be-4a38-b52a-c75066e7b265 for instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a on hv-cinder-83697 Jul 25 16:31:25.964561 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-9902b5b5-560b-41d0-a2c3-d99085114b44 req-96a3c41d-2214-40a7-9df4-0736217e0b87 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061993 Jul 25 16:31:25.965109 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 307/648] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:26.131179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6b865eb4-75ee-4eb1-af94-5a0cb54c3f55 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:26.131880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6b865eb4-75ee-4eb1-af94-5a0cb54c3f55 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:26.139594 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b865eb4-75ee-4eb1-af94-5a0cb54c3f55 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:26.140036 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b865eb4-75ee-4eb1-af94-5a0cb54c3f55 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:26.140896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b865eb4-75ee-4eb1-af94-5a0cb54c3f55 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:26.141359 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6b865eb4-75ee-4eb1-af94-5a0cb54c3f55 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:26.384665 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6b865eb4-75ee-4eb1-af94-5a0cb54c3f55 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:26.393863 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6b865eb4-75ee-4eb1-af94-5a0cb54c3f55 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.266965 Jul 25 16:31:26.394488 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 342/649] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:26 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:27.419175 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b0b3b5fa-3ada-409e-bdf6-71a31dcda38e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:27.419998 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b0b3b5fa-3ada-409e-bdf6-71a31dcda38e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:27.427175 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0b3b5fa-3ada-409e-bdf6-71a31dcda38e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:27.427614 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0b3b5fa-3ada-409e-bdf6-71a31dcda38e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:27.428411 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0b3b5fa-3ada-409e-bdf6-71a31dcda38e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:27.428837 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b0b3b5fa-3ada-409e-bdf6-71a31dcda38e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:27.607198 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b0b3b5fa-3ada-409e-bdf6-71a31dcda38e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:27.616484 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b0b3b5fa-3ada-409e-bdf6-71a31dcda38e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1265 microversion: 2.1 time: 0.202661 Jul 25 16:31:27.617092 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 308/650] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:27 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:28.652002 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-65dd45cb-34a0-4ec2-8a23-791ae80601b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:28.652881 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-65dd45cb-34a0-4ec2-8a23-791ae80601b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:28.663943 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65dd45cb-34a0-4ec2-8a23-791ae80601b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:28.664697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65dd45cb-34a0-4ec2-8a23-791ae80601b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:28.666171 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65dd45cb-34a0-4ec2-8a23-791ae80601b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:28.666960 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65dd45cb-34a0-4ec2-8a23-791ae80601b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:28.864786 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-65dd45cb-34a0-4ec2-8a23-791ae80601b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:28.875219 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-65dd45cb-34a0-4ec2-8a23-791ae80601b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1453 microversion: 2.1 time: 0.228587 Jul 25 16:31:28.876584 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 343/651] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:28 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1453 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:28.906445 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5cee5b28-7b60-4fc2-8b80-a8be48d57611 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:28.907274 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5cee5b28-7b60-4fc2-8b80-a8be48d57611 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:28.915208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5cee5b28-7b60-4fc2-8b80-a8be48d57611 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:28.915773 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5cee5b28-7b60-4fc2-8b80-a8be48d57611 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:28.916861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5cee5b28-7b60-4fc2-8b80-a8be48d57611 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:28.917323 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5cee5b28-7b60-4fc2-8b80-a8be48d57611 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:29.084611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5cee5b28-7b60-4fc2-8b80-a8be48d57611 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:29.100173 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5cee5b28-7b60-4fc2-8b80-a8be48d57611 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1453 microversion: 2.1 time: 0.198630 Jul 25 16:31:29.101271 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 309/652] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:28 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1453 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:31.623383 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-e101937b-4008-4ef3-b5c8-652261d6258d req-f47d2343-8293-4988-91b2-1c2f2e0d150a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8757e6e3-9388-4e11-9060-a1e8b7e2192a", "tag": "ba67a122-49be-4a38-b52a-c75066e7b265"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:31.638175 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e101937b-4008-4ef3-b5c8-652261d6258d req-f47d2343-8293-4988-91b2-1c2f2e0d150a service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:31.638884 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-e101937b-4008-4ef3-b5c8-652261d6258d req-f47d2343-8293-4988-91b2-1c2f2e0d150a service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:31.644010 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:31.654319 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-e101937b-4008-4ef3-b5c8-652261d6258d req-f47d2343-8293-4988-91b2-1c2f2e0d150a service nova] Creating event network-changed:ba67a122-49be-4a38-b52a-c75066e7b265 for instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a on hv-cinder-83697 Jul 25 16:31:31.660932 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-e101937b-4008-4ef3-b5c8-652261d6258d req-f47d2343-8293-4988-91b2-1c2f2e0d150a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041015 Jul 25 16:31:31.662560 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 344/653] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:31:35.479242 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3de51ae3-7e89-4eec-8861-10fdb263e741 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:35.480120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3de51ae3-7e89-4eec-8861-10fdb263e741 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:35.492438 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3de51ae3-7e89-4eec-8861-10fdb263e741 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:35.493247 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3de51ae3-7e89-4eec-8861-10fdb263e741 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:35.494728 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3de51ae3-7e89-4eec-8861-10fdb263e741 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:35.495518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3de51ae3-7e89-4eec-8861-10fdb263e741 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:35.531551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3de51ae3-7e89-4eec-8861-10fdb263e741 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/ips" status: 200 len: 150 microversion: 2.20 time: 0.060560 Jul 25 16:31:35.532464 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 310/654] 10.222.0.66 () {60 vars in 1289 bytes} [Mon Jul 25 16:31:35 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/ips => generated 150 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:31:37.522810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0cc505cb-40a0-4bf2-b12c-4203ccdef308 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:37.523908 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0cc505cb-40a0-4bf2-b12c-4203ccdef308 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:37.532050 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:37.540286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0cc505cb-40a0-4bf2-b12c-4203ccdef308 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:37.540848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0cc505cb-40a0-4bf2-b12c-4203ccdef308 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:37.541730 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0cc505cb-40a0-4bf2-b12c-4203ccdef308 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:37.542159 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0cc505cb-40a0-4bf2-b12c-4203ccdef308 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:37.572398 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-0cc505cb-40a0-4bf2-b12c-4203ccdef308 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lazy-loading 'flavor' on Instance uuid 9f714dd8-86f9-4043-8bb6-39286efcfc1e {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:31:37.803756 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0cc505cb-40a0-4bf2-b12c-4203ccdef308 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/action" status: 202 len: 0 microversion: 2.20 time: 0.293368 Jul 25 16:31:37.804825 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 345/655] 10.222.0.66 () {62 vars in 1319 bytes} [Mon Jul 25 16:31:37 2022] POST /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:31:37.815271 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:37.818369 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:37.828312 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:37.829140 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:37.830657 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:37.831360 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:38.055256 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:38.057782 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=71 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:38.066683 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:38.068270 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:38.069691 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-155a17aa-38fc-4aee-adf2-28a675bf4aa0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.259003 Jul 25 16:31:38.070352 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 311/656] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:37 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:39.105246 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:39.106680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:39.122431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:39.123328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:39.124800 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:39.125659 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:39.320392 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:39.329593 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:39.331118 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:39.332573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0463a8c1-8240-46d7-bc3d-525c2efb7b99 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.237840 Jul 25 16:31:39.333219 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 346/657] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:39 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:40.364701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:40.366007 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:40.370505 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:40.396824 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:40.397587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:40.398980 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:40.399800 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:40.604335 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:40.616288 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:40.618397 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:40.620203 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bbe6b1d5-d5a9-41d9-a99b-5032fcede1b2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.265260 Jul 25 16:31:40.620927 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 312/658] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:40 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:41.653038 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:41.653923 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:41.661468 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:41.662043 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:41.662857 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:41.663812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:41.854860 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:41.867919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:41.870482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:41.871843 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9b0f2775-e8f8-4f25-9e77-97167ae77103 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.223169 Jul 25 16:31:41.872587 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 347/659] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:41 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:42.471840 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-120f3380-611e-4558-b5e6-ef96eb7fdefc tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:42.472792 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-120f3380-611e-4558-b5e6-ef96eb7fdefc tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:42.481066 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-120f3380-611e-4558-b5e6-ef96eb7fdefc tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:42.481551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-120f3380-611e-4558-b5e6-ef96eb7fdefc tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:42.482437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-120f3380-611e-4558-b5e6-ef96eb7fdefc tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:42.482928 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-120f3380-611e-4558-b5e6-ef96eb7fdefc tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:42.525935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-120f3380-611e-4558-b5e6-ef96eb7fdefc tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lazy-loading 'flavor' on Instance uuid e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:31:42.648745 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-120f3380-611e-4558-b5e6-ef96eb7fdefc tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "POST /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb/action" status: 202 len: 0 microversion: 2.1 time: 0.182567 Jul 25 16:31:42.649761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 313/660] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:31:42 2022] POST /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:31:42.658812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bce97b86-8a28-4970-8cd2-99bd5785cfb0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:42.672347 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bce97b86-8a28-4970-8cd2-99bd5785cfb0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:42.689678 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bce97b86-8a28-4970-8cd2-99bd5785cfb0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:42.693181 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bce97b86-8a28-4970-8cd2-99bd5785cfb0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:42.696446 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bce97b86-8a28-4970-8cd2-99bd5785cfb0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:42.696811 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bce97b86-8a28-4970-8cd2-99bd5785cfb0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:42.909754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:42.910657 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:42.911084 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bce97b86-8a28-4970-8cd2-99bd5785cfb0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:42.919750 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:42.920343 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:42.922074 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:42.922281 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bce97b86-8a28-4970-8cd2-99bd5785cfb0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.267583 Jul 25 16:31:42.922684 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:42.929403 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 348/661] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:42 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:43.160903 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:43.170391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:43.171956 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:43.173262 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8c443709-ffba-49cb-a539-3d7307bf6adc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.274297 Jul 25 16:31:43.174143 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 314/662] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:42 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:31:43.953554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f9b85107-fbdb-4ddd-a3e1-285fe2b205d9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:43.955246 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f9b85107-fbdb-4ddd-a3e1-285fe2b205d9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:43.963122 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9b85107-fbdb-4ddd-a3e1-285fe2b205d9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:43.963564 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9b85107-fbdb-4ddd-a3e1-285fe2b205d9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:43.964362 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9b85107-fbdb-4ddd-a3e1-285fe2b205d9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:43.964821 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9b85107-fbdb-4ddd-a3e1-285fe2b205d9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:44.135940 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f9b85107-fbdb-4ddd-a3e1-285fe2b205d9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:44.150256 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f9b85107-fbdb-4ddd-a3e1-285fe2b205d9 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.202671 Jul 25 16:31:44.151290 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 349/663] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:43 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:44.215222 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:44.215964 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:44.224383 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:44.225651 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:44.226064 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:44.226746 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:44.437890 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:44.447164 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:44.448724 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:44.450048 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8ab5f8ef-0c13-4abd-9051-03c26c84fa51 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.239172 Jul 25 16:31:44.450688 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 315/664] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:44 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:45.190899 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-deb20742-9e44-4de3-848a-5ee11169c32d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:45.192067 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-deb20742-9e44-4de3-848a-5ee11169c32d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:45.202307 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-deb20742-9e44-4de3-848a-5ee11169c32d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:45.202956 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-deb20742-9e44-4de3-848a-5ee11169c32d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:45.203885 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-deb20742-9e44-4de3-848a-5ee11169c32d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:45.204468 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-deb20742-9e44-4de3-848a-5ee11169c32d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:45.393412 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-deb20742-9e44-4de3-848a-5ee11169c32d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:45.407951 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-deb20742-9e44-4de3-848a-5ee11169c32d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.224539 Jul 25 16:31:45.408673 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 350/665] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:45 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:45.479580 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:45.480584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:45.494979 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:45.495832 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:45.497255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:45.498066 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:45.734120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:45.750968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:45.754403 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:45.756652 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-792d64f5-2b06-4c56-8d6b-4f26d41ae2d3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.284546 Jul 25 16:31:45.757807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 316/666] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:45 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:31:46.445686 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5abf81d8-7235-49e9-b088-a70bf0e20716 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:46.446478 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5abf81d8-7235-49e9-b088-a70bf0e20716 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:46.454532 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5abf81d8-7235-49e9-b088-a70bf0e20716 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:46.454847 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5abf81d8-7235-49e9-b088-a70bf0e20716 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:46.455759 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5abf81d8-7235-49e9-b088-a70bf0e20716 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:46.456391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5abf81d8-7235-49e9-b088-a70bf0e20716 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:46.624578 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5abf81d8-7235-49e9-b088-a70bf0e20716 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:46.633181 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5abf81d8-7235-49e9-b088-a70bf0e20716 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.193676 Jul 25 16:31:46.633850 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 351/667] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:46 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:46.798505 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:46.799555 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:46.809307 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:46.809966 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:46.810942 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:46.811474 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:46.995111 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:47.006347 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:47.008583 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:47.010137 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02e7a845-a59b-4e6e-a365-f3bbf5585668 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.217628 Jul 25 16:31:47.010798 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 317/668] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:46 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:47.665077 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5db20d6d-090e-4251-866c-cf3493e5ae5d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:47.667573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5db20d6d-090e-4251-866c-cf3493e5ae5d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:47.682299 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5db20d6d-090e-4251-866c-cf3493e5ae5d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:47.683125 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5db20d6d-090e-4251-866c-cf3493e5ae5d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:47.684633 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5db20d6d-090e-4251-866c-cf3493e5ae5d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:47.685807 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5db20d6d-090e-4251-866c-cf3493e5ae5d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:47.891703 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5db20d6d-090e-4251-866c-cf3493e5ae5d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:47.902188 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5db20d6d-090e-4251-866c-cf3493e5ae5d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.248128 Jul 25 16:31:47.903047 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 352/669] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:47 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:48.051316 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:48.052500 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:48.063621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:48.064514 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:48.066074 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:48.066833 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:48.310470 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:48.319525 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:48.321140 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:48.322430 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-961154e1-bec1-4d55-b0e6-05026c52f4f3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.278709 Jul 25 16:31:48.323023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 318/670] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:48 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:48.927933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c4f07bf9-1dc8-428d-88b6-d923b892dcd2 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:48.930008 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c4f07bf9-1dc8-428d-88b6-d923b892dcd2 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:48.941217 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4f07bf9-1dc8-428d-88b6-d923b892dcd2 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:48.941977 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4f07bf9-1dc8-428d-88b6-d923b892dcd2 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:48.943288 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4f07bf9-1dc8-428d-88b6-d923b892dcd2 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:48.943960 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c4f07bf9-1dc8-428d-88b6-d923b892dcd2 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:49.141553 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c4f07bf9-1dc8-428d-88b6-d923b892dcd2 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:49.155623 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c4f07bf9-1dc8-428d-88b6-d923b892dcd2 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.233668 Jul 25 16:31:49.156806 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 353/671] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:48 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:49.347370 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:49.348935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:49.356734 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:49.357274 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:49.358228 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:49.358660 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:49.579021 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:49.589198 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:49.590903 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:49.592184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-510a0c0e-f1fd-4475-901a-63c6037001dd tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.249109 Jul 25 16:31:49.592770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 319/672] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:49 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:50.193035 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e0520f31-1ecd-4ee2-a08c-ec9d552656f5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:50.194284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e0520f31-1ecd-4ee2-a08c-ec9d552656f5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:50.203843 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e0520f31-1ecd-4ee2-a08c-ec9d552656f5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:50.204701 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e0520f31-1ecd-4ee2-a08c-ec9d552656f5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:50.205945 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e0520f31-1ecd-4ee2-a08c-ec9d552656f5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:50.206599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e0520f31-1ecd-4ee2-a08c-ec9d552656f5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:50.423676 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e0520f31-1ecd-4ee2-a08c-ec9d552656f5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:50.433029 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e0520f31-1ecd-4ee2-a08c-ec9d552656f5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.245010 Jul 25 16:31:50.440780 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 354/673] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:50 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:50.621363 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:50.622575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:50.633623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:50.634322 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:50.635575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:50.636298 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:50.836085 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:50.854195 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:50.857198 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:50.859141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-46aa4619-abc8-418f-9761-46fc56f79b11 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.242382 Jul 25 16:31:50.860091 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 320/674] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:50 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:51.463886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2f983c21-1f8e-4b91-8c9a-edfb51d6bb7e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:51.464765 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2f983c21-1f8e-4b91-8c9a-edfb51d6bb7e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:51.474769 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f983c21-1f8e-4b91-8c9a-edfb51d6bb7e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:51.475797 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f983c21-1f8e-4b91-8c9a-edfb51d6bb7e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:51.477372 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f983c21-1f8e-4b91-8c9a-edfb51d6bb7e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:51.478120 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2f983c21-1f8e-4b91-8c9a-edfb51d6bb7e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:51.663050 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2f983c21-1f8e-4b91-8c9a-edfb51d6bb7e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:51.685281 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2f983c21-1f8e-4b91-8c9a-edfb51d6bb7e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.217773 Jul 25 16:31:51.685281 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 355/675] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:51 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:51.894413 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:51.896708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:51.908911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:51.910091 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:51.911922 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:51.913261 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.122544 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:52.138120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:52.138120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:52.138120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dbe83d16-79cd-4d12-9f69-23b33a642d83 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.247949 Jul 25 16:31:52.138611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 321/676] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:51 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:52.707284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0766953a-dbf6-4b78-962f-18bedca93038 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:52.708113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0766953a-dbf6-4b78-962f-18bedca93038 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:52.716403 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0766953a-dbf6-4b78-962f-18bedca93038 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:52.716751 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0766953a-dbf6-4b78-962f-18bedca93038 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.717773 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0766953a-dbf6-4b78-962f-18bedca93038 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:52.718348 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0766953a-dbf6-4b78-962f-18bedca93038 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:52.917280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0766953a-dbf6-4b78-962f-18bedca93038 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:52.931407 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0766953a-dbf6-4b78-962f-18bedca93038 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.228248 Jul 25 16:31:52.932389 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 356/677] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:52 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:53.163182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:53.164509 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:53.173292 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.174051 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:53.175061 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.175798 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:53.526838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:53.537524 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:53.539313 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:53.540535 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-814b5d15-d1eb-447f-bc7c-043a5e6b976c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.381693 Jul 25 16:31:53.541100 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 322/678] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:53 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:31:53.966973 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-40fce1a1-2bbc-4336-9b73-fd5dd611d12f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:53.968277 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-40fce1a1-2bbc-4336-9b73-fd5dd611d12f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:53.976415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40fce1a1-2bbc-4336-9b73-fd5dd611d12f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.976848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40fce1a1-2bbc-4336-9b73-fd5dd611d12f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:53.978126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40fce1a1-2bbc-4336-9b73-fd5dd611d12f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:53.978598 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-40fce1a1-2bbc-4336-9b73-fd5dd611d12f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:54.239929 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-40fce1a1-2bbc-4336-9b73-fd5dd611d12f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:54.254338 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-40fce1a1-2bbc-4336-9b73-fd5dd611d12f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.292171 Jul 25 16:31:54.255376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 357/679] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:53 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:31:54.578285 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:54.579397 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:54.593256 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:54.594136 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:54.595638 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:54.596366 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:54.795236 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:54.812022 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:54.815129 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:54.817436 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-32b3f7b0-9a02-4acf-9e93-4c2d0076db24 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1743 microversion: 2.20 time: 0.246976 Jul 25 16:31:54.818530 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 323/680] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:54 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1743 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:55.294363 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ccb14023-6c6e-42cf-973b-a43b2732640f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:55.295342 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ccb14023-6c6e-42cf-973b-a43b2732640f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:55.304355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ccb14023-6c6e-42cf-973b-a43b2732640f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:55.304771 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ccb14023-6c6e-42cf-973b-a43b2732640f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:55.305659 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ccb14023-6c6e-42cf-973b-a43b2732640f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:55.306102 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ccb14023-6c6e-42cf-973b-a43b2732640f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:55.520335 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ccb14023-6c6e-42cf-973b-a43b2732640f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:55.535138 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ccb14023-6c6e-42cf-973b-a43b2732640f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.244527 Jul 25 16:31:55.536102 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 358/681] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:55 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:55.857893 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:55.858655 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:55.868314 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:55.868683 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:55.869562 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:55.869991 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:56.461574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:56.479891 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:56.484546 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:56.486426 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-92b6bae4-2419-472a-8fa8-d73eeb57129a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1743 microversion: 2.20 time: 0.633205 Jul 25 16:31:56.487796 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 324/682] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:55 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1743 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:56.575256 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9edf5c70-4d2e-4013-b868-baa427697624 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:56.578441 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9edf5c70-4d2e-4013-b868-baa427697624 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:56.596514 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9edf5c70-4d2e-4013-b868-baa427697624 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:56.597935 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9edf5c70-4d2e-4013-b868-baa427697624 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:56.599650 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9edf5c70-4d2e-4013-b868-baa427697624 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:56.600681 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9edf5c70-4d2e-4013-b868-baa427697624 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:56.652358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:56.872474 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9edf5c70-4d2e-4013-b868-baa427697624 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:56.886786 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9edf5c70-4d2e-4013-b868-baa427697624 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1571 microversion: 2.1 time: 0.320024 Jul 25 16:31:56.888332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 359/683] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:56 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1571 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:56.924022 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96ca1e85-a2b1-4b44-ac67-aba9669e0ed5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:56.925286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96ca1e85-a2b1-4b44-ac67-aba9669e0ed5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:56.932478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96ca1e85-a2b1-4b44-ac67-aba9669e0ed5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:56.933259 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96ca1e85-a2b1-4b44-ac67-aba9669e0ed5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:56.934174 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96ca1e85-a2b1-4b44-ac67-aba9669e0ed5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:56.935012 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96ca1e85-a2b1-4b44-ac67-aba9669e0ed5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:57.067689 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:31:57.121931 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96ca1e85-a2b1-4b44-ac67-aba9669e0ed5 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "POST /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb/action" status: 202 len: 0 microversion: 2.1 time: 0.201394 Jul 25 16:31:57.127164 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 325/684] 10.222.0.66 () {60 vars in 1278 bytes} [Mon Jul 25 16:31:56 2022] POST /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 16:31:57.137955 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-466cd1cf-e9fe-476d-9143-4baef5f9b215 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:57.139070 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-466cd1cf-e9fe-476d-9143-4baef5f9b215 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:57.160213 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-466cd1cf-e9fe-476d-9143-4baef5f9b215 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:57.161612 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-466cd1cf-e9fe-476d-9143-4baef5f9b215 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:57.161612 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-466cd1cf-e9fe-476d-9143-4baef5f9b215 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:57.161980 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-466cd1cf-e9fe-476d-9143-4baef5f9b215 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:57.479246 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-466cd1cf-e9fe-476d-9143-4baef5f9b215 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:57.491158 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-466cd1cf-e9fe-476d-9143-4baef5f9b215 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1519 microversion: 2.1 time: 0.361504 Jul 25 16:31:57.492609 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 360/685] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:57 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1519 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:57.538975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:57.540992 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:57.565293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:57.566115 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:57.577416 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:57.583346 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:57.984094 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:58.016964 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:58.029469 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:58.039735 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4dd72f5c-b541-41bf-b524-f28d5658f406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.505432 Jul 25 16:31:58.052729 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 326/686] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:57 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:58.180903 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-6a319562-3125-4953-ae3d-5559a2518329 req-1b35aad7-d358-4f1b-bd70-89fef2151267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714dd8-86f9-4043-8bb6-39286efcfc1e", "name": "network-vif-plugged", "status": "completed", "tag": "67736d36-f7e4-45ee-9af7-218a816c87b0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:31:58.216192 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-6a319562-3125-4953-ae3d-5559a2518329 req-1b35aad7-d358-4f1b-bd70-89fef2151267 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:58.217209 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-6a319562-3125-4953-ae3d-5559a2518329 req-1b35aad7-d358-4f1b-bd70-89fef2151267 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:58.232500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-6a319562-3125-4953-ae3d-5559a2518329 req-1b35aad7-d358-4f1b-bd70-89fef2151267 service nova] Creating event network-vif-plugged:67736d36-f7e4-45ee-9af7-218a816c87b0 for instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e on hv-cinder-83697 Jul 25 16:31:58.244224 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-6a319562-3125-4953-ae3d-5559a2518329 req-1b35aad7-d358-4f1b-bd70-89fef2151267 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067230 Jul 25 16:31:58.245639 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 361/687] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:31:58.534988 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-824d4db7-8833-4bb1-b5f1-1cd88e75aa2e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:58.536970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-824d4db7-8833-4bb1-b5f1-1cd88e75aa2e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:58.554281 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-824d4db7-8833-4bb1-b5f1-1cd88e75aa2e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:58.555676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-824d4db7-8833-4bb1-b5f1-1cd88e75aa2e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:58.561367 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-824d4db7-8833-4bb1-b5f1-1cd88e75aa2e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:58.562523 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-824d4db7-8833-4bb1-b5f1-1cd88e75aa2e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:58.870723 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-824d4db7-8833-4bb1-b5f1-1cd88e75aa2e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:58.883939 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-824d4db7-8833-4bb1-b5f1-1cd88e75aa2e tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1519 microversion: 2.1 time: 0.357568 Jul 25 16:31:58.884605 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 327/688] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:58 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1519 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:31:59.085142 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:59.085142 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:59.100727 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:59.107281 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:59.115689 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:59.116254 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:59.433462 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:59.451581 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:59.455861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:31:59.458802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cb9e7e74-2ab7-445e-ba01-0b68c15952b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.379131 Jul 25 16:31:59.474703 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 362/689] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:31:59 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:31:59.940425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7094bd0f-45c0-43ff-8ea9-8fbead09bf2d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:31:59.942566 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7094bd0f-45c0-43ff-8ea9-8fbead09bf2d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:31:59.973010 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7094bd0f-45c0-43ff-8ea9-8fbead09bf2d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:59.978648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7094bd0f-45c0-43ff-8ea9-8fbead09bf2d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:31:59.981243 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7094bd0f-45c0-43ff-8ea9-8fbead09bf2d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:31:59.983024 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7094bd0f-45c0-43ff-8ea9-8fbead09bf2d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:00.278873 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-56c3d8a0-ba74-477d-8078-75e724e9aa4e req-b7094409-3eca-47a7-90fc-927a448ce0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb", "name": "network-vif-unplugged", "status": "completed", "tag": "54cf1201-fdc0-44ce-bc59-698ade1f2c99"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:00.302461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-56c3d8a0-ba74-477d-8078-75e724e9aa4e req-b7094409-3eca-47a7-90fc-927a448ce0bc service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:00.303586 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-56c3d8a0-ba74-477d-8078-75e724e9aa4e req-b7094409-3eca-47a7-90fc-927a448ce0bc service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:00.337560 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-56c3d8a0-ba74-477d-8078-75e724e9aa4e req-b7094409-3eca-47a7-90fc-927a448ce0bc service nova] Creating event network-vif-unplugged:54cf1201-fdc0-44ce-bc59-698ade1f2c99 for instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb on hv-cinder-83697 Jul 25 16:32:00.361263 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-56c3d8a0-ba74-477d-8078-75e724e9aa4e req-b7094409-3eca-47a7-90fc-927a448ce0bc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088217 Jul 25 16:32:00.363946 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 363/690] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:00.365744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7094bd0f-45c0-43ff-8ea9-8fbead09bf2d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:00.377594 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7094bd0f-45c0-43ff-8ea9-8fbead09bf2d tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1521 microversion: 2.1 time: 0.446356 Jul 25 16:32:00.393769 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 328/691] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:31:59 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:00.517456 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:00.521032 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:00.533535 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:00.534790 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:00.536539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:00.537651 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:00.880649 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:00.902124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:00.906162 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:00.909235 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d467fa94-0374-448a-8a45-5f63eb759af6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.403731 Jul 25 16:32:00.925430 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 364/692] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:00 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:01.409682 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-008d9116-c42f-43b1-81d7-e5d93f188c9f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:01.411175 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-008d9116-c42f-43b1-81d7-e5d93f188c9f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:01.423934 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-008d9116-c42f-43b1-81d7-e5d93f188c9f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:01.424708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-008d9116-c42f-43b1-81d7-e5d93f188c9f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:01.426547 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-008d9116-c42f-43b1-81d7-e5d93f188c9f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:01.427725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-008d9116-c42f-43b1-81d7-e5d93f188c9f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:01.770827 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-008d9116-c42f-43b1-81d7-e5d93f188c9f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:01.786916 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-008d9116-c42f-43b1-81d7-e5d93f188c9f tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.386913 Jul 25 16:32:01.788157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 329/693] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:01 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:01.957580 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:01.960137 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:01.989878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:01.990966 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:01.992358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:01.993433 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:02.229558 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:02.245560 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:02.252317 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:02.254287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b8b24780-e732-43c0-b3f6-1d305417fb88 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.309143 Jul 25 16:32:02.255698 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 365/694] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:01 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:02.830819 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fd9a12cf-f2ec-443a-b7fb-16e8e15fce45 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:02.832599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fd9a12cf-f2ec-443a-b7fb-16e8e15fce45 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:02.855600 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd9a12cf-f2ec-443a-b7fb-16e8e15fce45 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:02.856112 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd9a12cf-f2ec-443a-b7fb-16e8e15fce45 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:02.857023 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd9a12cf-f2ec-443a-b7fb-16e8e15fce45 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:02.857661 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fd9a12cf-f2ec-443a-b7fb-16e8e15fce45 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:03.108924 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fd9a12cf-f2ec-443a-b7fb-16e8e15fce45 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:03.124370 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fd9a12cf-f2ec-443a-b7fb-16e8e15fce45 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.304332 Jul 25 16:32:03.147617 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 330/695] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:02 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:03.297809 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:03.299177 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:03.308039 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:03.308685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:03.309647 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:03.310354 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:03.538484 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:03.558313 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:03.561111 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:03.562675 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-68bd79e4-9613-4fa7-aa1a-067deb20347f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.275055 Jul 25 16:32:03.563838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 366/696] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:03 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:04.169656 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7f90cad-ca62-49f1-a63e-1969c5c73567 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:04.170823 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a7f90cad-ca62-49f1-a63e-1969c5c73567 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:04.188733 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7f90cad-ca62-49f1-a63e-1969c5c73567 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:04.190541 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7f90cad-ca62-49f1-a63e-1969c5c73567 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:04.191873 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7f90cad-ca62-49f1-a63e-1969c5c73567 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:04.192447 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7f90cad-ca62-49f1-a63e-1969c5c73567 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:04.428929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a7f90cad-ca62-49f1-a63e-1969c5c73567 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:04.451887 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a7f90cad-ca62-49f1-a63e-1969c5c73567 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.289004 Jul 25 16:32:04.453250 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 331/697] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:04 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:04.603483 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:04.604498 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:04.615583 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:04.616909 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:04.618463 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:04.619537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:04.868809 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:04.884349 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:04.887763 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:04.890024 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-343b5ab6-833d-4190-907c-192626e7a59a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.291771 Jul 25 16:32:04.905378 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 367/698] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:04 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:05.493419 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-190c3512-7f89-434a-97c6-16a5e0007f23 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:05.499610 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-190c3512-7f89-434a-97c6-16a5e0007f23 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:05.507317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-190c3512-7f89-434a-97c6-16a5e0007f23 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:05.507799 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-190c3512-7f89-434a-97c6-16a5e0007f23 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:05.508612 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-190c3512-7f89-434a-97c6-16a5e0007f23 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:05.509241 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-190c3512-7f89-434a-97c6-16a5e0007f23 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:05.760077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-190c3512-7f89-434a-97c6-16a5e0007f23 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:05.772384 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-190c3512-7f89-434a-97c6-16a5e0007f23 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.285501 Jul 25 16:32:05.773131 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 332/699] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:05 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:05.917087 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:05.918131 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:05.938052 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:05.938847 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:05.940579 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:05.941460 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.144814 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:06.159007 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:06.161636 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:06.163311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cb0b9868-476c-4d09-9f69-dcb4b2e9ca3c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.250820 Jul 25 16:32:06.164135 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 368/700] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:05 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:06.808478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c520dc83-cfa1-4c27-8892-db95f6746141 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:06.810810 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c520dc83-cfa1-4c27-8892-db95f6746141 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:06.826801 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c520dc83-cfa1-4c27-8892-db95f6746141 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.827683 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c520dc83-cfa1-4c27-8892-db95f6746141 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:06.829171 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c520dc83-cfa1-4c27-8892-db95f6746141 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:06.830085 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c520dc83-cfa1-4c27-8892-db95f6746141 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:07.121171 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c520dc83-cfa1-4c27-8892-db95f6746141 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:07.134683 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c520dc83-cfa1-4c27-8892-db95f6746141 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.333524 Jul 25 16:32:07.152183 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 333/701] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:06 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:07.191086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:07.193135 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:07.205327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:07.206174 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:07.207758 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:07.208861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:07.467889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:07.483578 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:07.487915 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:07.489897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-90200b11-f21e-45ab-920d-7f903227f33c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.303959 Jul 25 16:32:07.506024 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 369/702] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:07 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:08.175503 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a47554a0-ef6b-49e3-8a04-61e8a0a2f480 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:08.176611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a47554a0-ef6b-49e3-8a04-61e8a0a2f480 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:08.187743 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a47554a0-ef6b-49e3-8a04-61e8a0a2f480 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.188865 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a47554a0-ef6b-49e3-8a04-61e8a0a2f480 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.191255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a47554a0-ef6b-49e3-8a04-61e8a0a2f480 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.192245 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a47554a0-ef6b-49e3-8a04-61e8a0a2f480 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.433167 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a47554a0-ef6b-49e3-8a04-61e8a0a2f480 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.447171 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a47554a0-ef6b-49e3-8a04-61e8a0a2f480 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.277085 Jul 25 16:32:08.447983 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 334/703] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:08 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:08.525708 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:08.526759 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:08.530413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=50 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:08.540979 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.541843 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.543389 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:08.544177 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:08.798817 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.811439 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.813707 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:08.815114 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f71af2ff-7ddd-4230-acc8-2d505122ddce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.294124 Jul 25 16:32:08.816372 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 370/704] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:08 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:32:09.479430 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96667465-987a-4f2a-b7f1-1e36e8750348 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:09.480990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96667465-987a-4f2a-b7f1-1e36e8750348 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:09.488693 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96667465-987a-4f2a-b7f1-1e36e8750348 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:09.489134 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96667465-987a-4f2a-b7f1-1e36e8750348 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:09.490356 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96667465-987a-4f2a-b7f1-1e36e8750348 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:09.490913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96667465-987a-4f2a-b7f1-1e36e8750348 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:09.667553 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96667465-987a-4f2a-b7f1-1e36e8750348 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:09.676267 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96667465-987a-4f2a-b7f1-1e36e8750348 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.204740 Jul 25 16:32:09.676902 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 335/705] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:09 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:09.857386 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:09.858503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:09.871253 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:09.872001 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:09.873577 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:09.874299 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:10.067962 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:10.081648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:10.085017 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:10.086837 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ea59aea5-cb11-488f-a519-665e8670048e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1738 microversion: 2.20 time: 0.237041 Jul 25 16:32:10.087633 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 371/706] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:09 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:10.715705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dd86b308-1dad-4862-b489-b526f996a8c0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:10.717911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dd86b308-1dad-4862-b489-b526f996a8c0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:10.723864 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=50 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:10.732309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd86b308-1dad-4862-b489-b526f996a8c0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:10.733076 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd86b308-1dad-4862-b489-b526f996a8c0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:10.734674 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd86b308-1dad-4862-b489-b526f996a8c0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:10.735428 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dd86b308-1dad-4862-b489-b526f996a8c0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:10.928224 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dd86b308-1dad-4862-b489-b526f996a8c0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:10.940104 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dd86b308-1dad-4862-b489-b526f996a8c0 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.231054 Jul 25 16:32:10.946637 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 336/707] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:10 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:11.119784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:11.120719 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:11.128379 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:11.128908 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:11.129794 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:11.130314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:11.313839 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:11.323616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:11.325305 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:11.326651 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fbf5ca31-440c-4ba9-8b5e-aa50cc0c60cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1720 microversion: 2.20 time: 0.211523 Jul 25 16:32:11.327331 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 372/708] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:11 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:11.975675 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5057bc32-b00e-417e-9a0c-4058010552ec tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:11.976561 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5057bc32-b00e-417e-9a0c-4058010552ec tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:11.985754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5057bc32-b00e-417e-9a0c-4058010552ec tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:11.986855 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5057bc32-b00e-417e-9a0c-4058010552ec tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:11.987892 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5057bc32-b00e-417e-9a0c-4058010552ec tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:11.988393 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5057bc32-b00e-417e-9a0c-4058010552ec tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:12.028537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-883d37db-a257-44b8-a157-9d90eb1b1538 req-6313015e-a0ce-4db0-bf15-bf4c95df1d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb", "name": "network-vif-plugged", "status": "completed", "tag": "54cf1201-fdc0-44ce-bc59-698ade1f2c99"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:12.043465 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-883d37db-a257-44b8-a157-9d90eb1b1538 req-6313015e-a0ce-4db0-bf15-bf4c95df1d19 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:12.044434 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-883d37db-a257-44b8-a157-9d90eb1b1538 req-6313015e-a0ce-4db0-bf15-bf4c95df1d19 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:12.068284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-883d37db-a257-44b8-a157-9d90eb1b1538 req-6313015e-a0ce-4db0-bf15-bf4c95df1d19 service nova] Creating event network-vif-plugged:54cf1201-fdc0-44ce-bc59-698ade1f2c99 for instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb on hv-cinder-83697 Jul 25 16:32:12.078618 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-883d37db-a257-44b8-a157-9d90eb1b1538 req-6313015e-a0ce-4db0-bf15-bf4c95df1d19 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057176 Jul 25 16:32:12.079963 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 373/709] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:32:12.171575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5057bc32-b00e-417e-9a0c-4058010552ec tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:12.185807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5057bc32-b00e-417e-9a0c-4058010552ec tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.214810 Jul 25 16:32:12.190131 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 337/710] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:11 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:32:12.357705 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:12.362028 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:12.368462 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:12.368940 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:12.369786 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:12.370224 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:12.575446 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:12.591158 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:12.592884 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:12.594437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fb8637d7-993a-4854-847e-1cc9ccdb222d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1720 microversion: 2.20 time: 0.242134 Jul 25 16:32:12.595203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 374/711] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:12 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:32:13.209022 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b4985a69-d70b-4bed-8509-7807a07afc24 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:13.209777 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b4985a69-d70b-4bed-8509-7807a07afc24 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:13.217276 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4985a69-d70b-4bed-8509-7807a07afc24 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.217831 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4985a69-d70b-4bed-8509-7807a07afc24 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:13.218689 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4985a69-d70b-4bed-8509-7807a07afc24 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.219166 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b4985a69-d70b-4bed-8509-7807a07afc24 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:13.418756 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b4985a69-d70b-4bed-8509-7807a07afc24 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:13.431078 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b4985a69-d70b-4bed-8509-7807a07afc24 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1577 microversion: 2.1 time: 0.226128 Jul 25 16:32:13.431787 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 338/712] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:13 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:13.628159 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:13.628952 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:13.640663 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.641466 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:13.642929 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.643662 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:13.867419 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:13.888734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:13.891320 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:13.892941 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7fbbc3e0-2a30-42fe-9d02-729a7cc5a5cc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1663 microversion: 2.20 time: 0.273588 Jul 25 16:32:13.906046 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 375/713] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:13 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1663 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:13.929905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f28e593d-b0fe-47a5-8c19-029789efd12e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58beefae-4406-4ca3-9707-38048a7649c2"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:13.932773 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f28e593d-b0fe-47a5-8c19-029789efd12e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:13.940812 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f28e593d-b0fe-47a5-8c19-029789efd12e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.942086 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f28e593d-b0fe-47a5-8c19-029789efd12e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:13.943044 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f28e593d-b0fe-47a5-8c19-029789efd12e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:13.943654 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f28e593d-b0fe-47a5-8c19-029789efd12e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.104256 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-26a3835e-2b28-439a-be72-5a0b234568b6 req-375f8bf8-c3dc-4dd2-af29-3c5cec6d505d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714dd8-86f9-4043-8bb6-39286efcfc1e", "name": "network-vif-unplugged", "status": "completed", "tag": "67736d36-f7e4-45ee-9af7-218a816c87b0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:14.125149 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-26a3835e-2b28-439a-be72-5a0b234568b6 req-375f8bf8-c3dc-4dd2-af29-3c5cec6d505d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:14.125491 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-26a3835e-2b28-439a-be72-5a0b234568b6 req-375f8bf8-c3dc-4dd2-af29-3c5cec6d505d service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.151412 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.compute.server_external_events [req-26a3835e-2b28-439a-be72-5a0b234568b6 req-375f8bf8-c3dc-4dd2-af29-3c5cec6d505d service nova] Unable to find a host for instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e. Dropping event network-vif-unplugged {{(pid=117919) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 16:32:14.153737 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-26a3835e-2b28-439a-be72-5a0b234568b6 req-375f8bf8-c3dc-4dd2-af29-3c5cec6d505d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055472 Jul 25 16:32:14.155457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 376/714] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 16:32:14.394923 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:14.426443 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f28e593d-b0fe-47a5-8c19-029789efd12e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.500876 Jul 25 16:32:14.433424 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 339/715] 10.222.0.66 () {62 vars in 1364 bytes} [Mon Jul 25 16:32:13 2022] POST /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments => generated 188 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:32:14.457364 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-66c93d93-9988-4def-86ac-6740ea891274 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:14.458423 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-66c93d93-9988-4def-86ac-6740ea891274 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:14.468221 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66c93d93-9988-4def-86ac-6740ea891274 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:14.468956 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66c93d93-9988-4def-86ac-6740ea891274 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.470376 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66c93d93-9988-4def-86ac-6740ea891274 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:14.471065 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66c93d93-9988-4def-86ac-6740ea891274 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.596428 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d5c7a60c-e776-4c1a-94c0-d87430336987 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:14.597076 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d5c7a60c-e776-4c1a-94c0-d87430336987 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:14.605846 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c7a60c-e776-4c1a-94c0-d87430336987 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:14.606306 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c7a60c-e776-4c1a-94c0-d87430336987 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.607202 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c7a60c-e776-4c1a-94c0-d87430336987 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:14.607521 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d5c7a60c-e776-4c1a-94c0-d87430336987 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.696999 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-66c93d93-9988-4def-86ac-6740ea891274 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:14.709243 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-66c93d93-9988-4def-86ac-6740ea891274 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1564 microversion: 2.1 time: 0.257995 Jul 25 16:32:14.709923 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 377/716] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:32:14 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1564 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:32:14.728830 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d5c7a60c-e776-4c1a-94c0-d87430336987 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/action" status: 202 len: 0 microversion: 2.20 time: 0.137436 Jul 25 16:32:14.730078 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 340/717] 10.222.0.66 () {62 vars in 1319 bytes} [Mon Jul 25 16:32:14 2022] POST /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:32:14.743461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:14.744723 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:14.756208 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:14.756992 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.758424 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:14.759249 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:14.974439 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:14.978450 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=100 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:14.992165 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:14.994161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:14.995641 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-89083fef-7c9c-4de5-b814-09f1a7267d7a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1749 microversion: 2.20 time: 0.260463 Jul 25 16:32:14.997170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 378/718] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:14 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1749 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:32:16.024652 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:16.025757 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:16.036492 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:16.037270 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:16.038653 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:16.039371 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:16.218937 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:16.237034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:16.238943 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:16.240457 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-06774a11-1add-44a1-ac96-db3a02de0216 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1749 microversion: 2.20 time: 0.223806 Jul 25 16:32:16.241478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 341/719] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:16 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1749 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:17.267913 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:17.268576 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:17.276730 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:17.277178 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:17.278008 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:17.278463 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:17.469598 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:17.486368 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:17.489938 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:17.492227 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-61378d36-05b1-4a19-9d59-4285758b63a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1749 microversion: 2.20 time: 0.228228 Jul 25 16:32:17.493262 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 379/720] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:17 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1749 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:18.519794 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:18.520852 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:18.530036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:18.530599 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:18.531613 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:18.532146 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:18.768578 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:18.789397 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:18.792705 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:18.795200 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c9d1b7d8-d12f-4acc-9600-a7b244b6ffb9 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1751 microversion: 2.20 time: 0.280049 Jul 25 16:32:18.796252 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 342/721] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:18 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1751 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:19.837627 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:19.838507 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:19.849972 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:19.850763 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:19.852213 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:19.852962 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:20.084104 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:20.102482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:20.105700 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:20.108327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fdc4e037-31c2-4f74-88b8-1bc6065464f4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.276844 Jul 25 16:32:20.109533 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 380/722] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:19 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:21.144998 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:21.146707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:21.169763 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:21.170909 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:21.175922 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:21.175922 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:21.560989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:21.581663 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:21.585266 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:21.588016 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-006acbb4-a273-4607-b312-404950da0e72 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.449657 Jul 25 16:32:21.589438 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 343/723] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:21 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:22.622755 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:22.623800 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:22.638212 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:22.639390 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:22.641124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:22.642183 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:22.979880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:22.996310 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:23.001000 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:23.003513 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3e32caa3-c1e3-41b4-bd2b-2faee915fab5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.387631 Jul 25 16:32:23.028760 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 381/724] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:22 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:32:24.055176 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:24.056595 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:24.073454 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:24.074934 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:24.078068 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:24.079776 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:24.385738 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:24.405098 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:24.422748 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:24.448255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-08e87afb-1d22-4281-9262-52a657ae1ea7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.405785 Jul 25 16:32:24.452533 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 344/725] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:24 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:25.495983 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:25.509687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:25.525207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:25.529457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:25.534789 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:25.535690 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:25.735046 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:25.746909 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:25.751800 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:25.753508 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-72d94e5c-d3f7-49a3-9f50-ef4ccdfc00b8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.261884 Jul 25 16:32:25.771316 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 382/726] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:25 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:26.783490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:26.784585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:26.793421 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:26.794159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:26.795345 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:26.795948 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:27.076869 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:27.096793 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:27.101196 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:27.103575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f6c6ea9d-6717-458a-a5d0-00365c49c810 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.325161 Jul 25 16:32:27.104903 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 345/727] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:26 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:32:28.146688 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:28.148722 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:28.157813 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:28.158788 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:28.160229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:28.160809 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:28.430902 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:28.450079 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:28.453815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:28.456037 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4b0b7ce3-419d-4ba6-a546-765628fb3371 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.315448 Jul 25 16:32:28.457054 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 383/728] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:28 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:29.497953 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:29.499071 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:29.513310 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:29.513781 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:29.514753 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:29.515376 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:29.729034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:29.740830 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:29.743222 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:29.744726 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f41e7092-4438-42a8-a90e-225f7cde603d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.254139 Jul 25 16:32:29.745652 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 346/729] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:29 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:30.779815 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:30.780506 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:30.788694 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:30.789153 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:30.790043 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:30.790441 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:30.956640 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:30.972816 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:30.975998 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:30.978286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4886d65e-811f-47b1-a13c-7f156066b679 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.202382 Jul 25 16:32:30.979301 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 384/730] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:30 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:32.016666 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:32.017438 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:32.024987 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:32.025692 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:32.026513 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:32.027062 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:32.222045 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:32.237159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:32.240362 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:32.242690 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-99f8ce5c-42c5-467f-894c-4909d2426227 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.230028 Jul 25 16:32:32.243392 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 347/731] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:32 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:33.280054 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:33.280776 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:33.288232 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:33.288677 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:33.289526 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:33.289948 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:33.470955 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:33.481200 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:33.482827 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:33.484227 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-52e652ee-6c45-4c9d-9b83-2b98d2869e66 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.208152 Jul 25 16:32:33.484807 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 385/732] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:33 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:34.511271 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:34.512102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:34.520501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:34.521064 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:34.522313 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:34.522923 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:34.677116 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:34.687141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:34.688708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:34.689990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7552739e-5372-4146-a9a2-44fbc266d9db tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.183781 Jul 25 16:32:34.690584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 348/733] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:34 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:35.715824 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:35.716783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:35.724375 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.724974 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.725824 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:35.726324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:35.882935 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:35.893243 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:35.895047 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:35.896323 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-6d8f6aff-22a1-4d4c-97c1-b562bf9ae2b4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.185071 Jul 25 16:32:35.896985 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 386/734] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:35 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:36.921159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:36.922104 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:36.930178 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:36.930640 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:36.931434 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:36.931855 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:37.087702 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:37.098775 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:37.100443 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:37.101711 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1881d390-8aa1-443e-abba-918139f5fc26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.185063 Jul 25 16:32:37.102308 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 349/735] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:36 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:32:38.126515 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:38.127291 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:38.133950 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:38.134398 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:38.135193 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:38.135712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:38.185398 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-2a90d2b1-b126-4dda-9737-dc4a3be49bc0 req-77b9b763-c3e6-496d-be68-cb7aab40a75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714dd8-86f9-4043-8bb6-39286efcfc1e", "name": "network-vif-plugged", "status": "completed", "tag": "67736d36-f7e4-45ee-9af7-218a816c87b0"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:32:38.198290 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2a90d2b1-b126-4dda-9737-dc4a3be49bc0 req-77b9b763-c3e6-496d-be68-cb7aab40a75f service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:38.198754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-2a90d2b1-b126-4dda-9737-dc4a3be49bc0 req-77b9b763-c3e6-496d-be68-cb7aab40a75f service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:38.214791 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-2a90d2b1-b126-4dda-9737-dc4a3be49bc0 req-77b9b763-c3e6-496d-be68-cb7aab40a75f service nova] Creating event network-vif-plugged:67736d36-f7e4-45ee-9af7-218a816c87b0 for instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e on hv-cinder-83697 Jul 25 16:32:38.222381 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-2a90d2b1-b126-4dda-9737-dc4a3be49bc0 req-77b9b763-c3e6-496d-be68-cb7aab40a75f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040429 Jul 25 16:32:38.223667 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 350/736] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:32:38.303875 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:38.317135 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:38.318785 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:38.320003 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fd02230b-c4bb-4409-82ba-76f128639585 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.197565 Jul 25 16:32:38.320592 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 387/737] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:38 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:32:39.347576 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:39.348317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:39.356303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:39.356824 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:39.357790 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:39.358507 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:39.538825 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:39.554827 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:39.557663 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:39.559474 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-55c91467-424b-4f58-8214-bbfd31da0c61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.217033 Jul 25 16:32:39.560341 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 351/738] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:39 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:40.599791 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:40.600848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:40.604860 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=36 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:40.613153 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:40.613784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:40.614802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:40.615686 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:40.809771 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:40.827057 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:40.829697 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:40.831802 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0741146b-7b0b-4a1a-8970-1b19201050ec tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1807 microversion: 2.20 time: 0.238875 Jul 25 16:32:40.832817 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 388/739] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:40 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:32:41.859323 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:32:41.860069 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:32:41.863743 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=34 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:32:41.871047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.871559 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:41.872412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:32:41.872846 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:32:42.069722 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:42.086054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:42.089875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:32:42.092650 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1f296130-6bcd-46ff-9e24-bab2cf99bc42 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1794 microversion: 2.20 time: 0.237251 Jul 25 16:32:42.093772 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 352/740] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:32:41 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1794 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:14.809843 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c5d9edce-3a5d-4f94-9bf6-64cd9bea1d26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:14.810672 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c5d9edce-3a5d-4f94-9bf6-64cd9bea1d26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:14.812620 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:14.813629 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=61 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:14.823061 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5d9edce-3a5d-4f94-9bf6-64cd9bea1d26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.823822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5d9edce-3a5d-4f94-9bf6-64cd9bea1d26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.825194 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5d9edce-3a5d-4f94-9bf6-64cd9bea1d26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.826003 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c5d9edce-3a5d-4f94-9bf6-64cd9bea1d26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.876689 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c5d9edce-3a5d-4f94-9bf6-64cd9bea1d26 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments/58beefae-4406-4ca3-9707-38048a7649c2" status: 200 len: 194 microversion: 2.20 time: 0.072079 Jul 25 16:33:14.877426 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 389/741] 10.222.0.66 () {60 vars in 1454 bytes} [Mon Jul 25 16:33:14 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments/58beefae-4406-4ca3-9707-38048a7649c2 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:33:14.952612 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a7f9095b-fc50-477b-875c-5f4ed8d0b8e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:14.953371 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a7f9095b-fc50-477b-875c-5f4ed8d0b8e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:14.955386 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:14.956037 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:14.963702 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7f9095b-fc50-477b-875c-5f4ed8d0b8e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.964232 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7f9095b-fc50-477b-875c-5f4ed8d0b8e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:14.965016 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7f9095b-fc50-477b-875c-5f4ed8d0b8e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:14.965511 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a7f9095b-fc50-477b-875c-5f4ed8d0b8e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:15.089587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-a7f9095b-fc50-477b-875c-5f4ed8d0b8e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lazy-loading 'services' on Instance uuid 9f714dd8-86f9-4043-8bb6-39286efcfc1e {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:33:15.196290 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a7f9095b-fc50-477b-875c-5f4ed8d0b8e4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments/58beefae-4406-4ca3-9707-38048a7649c2" status: 202 len: 0 microversion: 2.20 time: 0.247372 Jul 25 16:33:15.197381 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 353/742] 10.222.0.66 () {60 vars in 1457 bytes} [Mon Jul 25 16:33:14 2022] DELETE /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments/58beefae-4406-4ca3-9707-38048a7649c2 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:33:15.209105 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-de27af27-d2bb-4f1f-b712-d5fe10b0a367 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:15.212322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-de27af27-d2bb-4f1f-b712-d5fe10b0a367 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:15.221030 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de27af27-d2bb-4f1f-b712-d5fe10b0a367 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:15.221561 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de27af27-d2bb-4f1f-b712-d5fe10b0a367 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:15.222824 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de27af27-d2bb-4f1f-b712-d5fe10b0a367 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:15.223512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de27af27-d2bb-4f1f-b712-d5fe10b0a367 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:15.275456 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-de27af27-d2bb-4f1f-b712-d5fe10b0a367 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071803 Jul 25 16:33:15.276413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 390/743] 10.222.0.66 () {60 vars in 1343 bytes} [Mon Jul 25 16:33:15 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:33:16.295368 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a4bdacae-71cd-4e6d-8337-e3a7088097e5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:16.297868 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a4bdacae-71cd-4e6d-8337-e3a7088097e5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:16.306511 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4bdacae-71cd-4e6d-8337-e3a7088097e5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.306983 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4bdacae-71cd-4e6d-8337-e3a7088097e5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.307773 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4bdacae-71cd-4e6d-8337-e3a7088097e5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.308198 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a4bdacae-71cd-4e6d-8337-e3a7088097e5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.343314 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a4bdacae-71cd-4e6d-8337-e3a7088097e5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055430 Jul 25 16:33:16.343949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 354/744] 10.222.0.66 () {60 vars in 1343 bytes} [Mon Jul 25 16:33:16 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:16.415190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ce75ded2-9ddc-4aac-a821-8928a201c406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:16.415892 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ce75ded2-9ddc-4aac-a821-8928a201c406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:16.424500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce75ded2-9ddc-4aac-a821-8928a201c406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.424980 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce75ded2-9ddc-4aac-a821-8928a201c406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.425882 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce75ded2-9ddc-4aac-a821-8928a201c406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.426367 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ce75ded2-9ddc-4aac-a821-8928a201c406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.459021 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ce75ded2-9ddc-4aac-a821-8928a201c406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:33:16.553649 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ce75ded2-9ddc-4aac-a821-8928a201c406 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 204 len: 0 microversion: 2.20 time: 0.142274 Jul 25 16:33:16.554261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 391/745] 10.222.0.66 () {60 vars in 1280 bytes} [Mon Jul 25 16:33:16 2022] DELETE /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:33:16.567255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:16.567917 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:16.574863 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.575427 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.576103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:16.576535 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:16.761017 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:16.771191 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:16.772749 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:16.774065 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-731adc30-dc2f-437c-8d30-059e9b54f7c4 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.214234 Jul 25 16:33:16.774675 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 355/746] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:16 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:17.799775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:17.800888 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:17.808528 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:17.809029 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:17.810005 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:17.810519 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:17.994342 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:18.004196 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:18.005768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:18.006958 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2debafc0-eb14-4f35-8784-ea3beba3275e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1722 microversion: 2.20 time: 0.212302 Jul 25 16:33:18.007880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 392/747] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:17 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:19.047038 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:19.047866 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:19.055739 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:19.056193 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:19.057030 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:19.057498 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:19.150065 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:19.160176 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:19.161803 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:19.163022 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-aa36029e-84c2-410c-98b9-ca55d27522f7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 200 len: 1654 microversion: 2.20 time: 0.122619 Jul 25 16:33:19.163720 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 356/748] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:19 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 1654 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:19.354625 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-de3c834c-a6c5-4f4b-a12e-5d224da6f5ca req-09bccd61-1a8d-4114-97c7-471c4cc001ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f714dd8-86f9-4043-8bb6-39286efcfc1e", "name": "network-vif-deleted", "tag": "67736d36-f7e4-45ee-9af7-218a816c87b0"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:19.377119 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-de3c834c-a6c5-4f4b-a12e-5d224da6f5ca req-09bccd61-1a8d-4114-97c7-471c4cc001ba service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:19.377965 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-de3c834c-a6c5-4f4b-a12e-5d224da6f5ca req-09bccd61-1a8d-4114-97c7-471c4cc001ba service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:19.401830 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-de3c834c-a6c5-4f4b-a12e-5d224da6f5ca req-09bccd61-1a8d-4114-97c7-471c4cc001ba service nova] Creating event network-vif-deleted:67736d36-f7e4-45ee-9af7-218a816c87b0 for instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e on hv-cinder-83697 Jul 25 16:33:19.409758 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-de3c834c-a6c5-4f4b-a12e-5d224da6f5ca req-09bccd61-1a8d-4114-97c7-471c4cc001ba service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063720 Jul 25 16:33:19.411305 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 393/749] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:20.206657 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:20.207768 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:20.220140 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:20.220931 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:20.222538 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:20.223275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:20.251783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] HTTP exception thrown: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Request method failure captured: Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e HTTP/1.1 Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sUoEWPqHoRbE4lTH8jJ-p_aTOc1Tv7QdX30xBOqxl2wfr3fMfaNKab8iAXjJR44Zh32k2_DZYH9uQsdVGJy0UjMDeZEhmT9MkcTvIGaV8_kGc1WTt9usx6TjxrkNP9lg2KH66fobtvF0EbKA5G9jhAYN2tY1WMIFGpMKwa2iaZBG50 Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:33:20.255156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4501489e56744cf98e49895b6d5aa6f8"}]}] Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 37e7fecdaae94842b6917152fb7f1598 Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:33:20.258058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '9f714dd8-86f9-4043-8bb6-39286efcfc1e'} Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:33:20.259557 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:33:20.262194 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:20.264674 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Returning 404 to user: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:33:20.264674 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bfdfbcc7-b2d3-4f27-b211-c042fbfb493d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 404 len: 111 microversion: 2.20 time: 0.058436 Jul 25 16:33:20.264674 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 357/750] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:20 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:33:20.271739 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-60213b37-c191-4f67-9a29-8a813f2119d7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '.version_select at 0x7f440a617040>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:20.306469 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-60213b37-c191-4f67-9a29-8a813f2119d7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809165704" status: 204 len: 0 microversion: 2.20 time: 0.038476 Jul 25 16:33:20.307627 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 394/751] 10.222.0.66 () {60 vars in 1262 bytes} [Mon Jul 25 16:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809165704 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:33:21.346992 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8bdee736-9835-460e-8163-7f9d4aa88de0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'create', calling method: .version_select at 0x7f440aed5f70>, body: {"keypair": {"name": "tempest-keypair-250084202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8Ozz+i20mIRLgoR4vT77MB8zADWxmNeHkjr/g4CJZVR9ihy6xe/xTqvcKDU+DWis9bT4JYJGadhnZz703Rh1gxh1wAacqaVM1jkJkdZGEYi6/DjjKhhrU1DZBIQy7r0A=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:21.375349 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8bdee736-9835-460e-8163-7f9d4aa88de0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Getting quotas for project 4501489e56744cf98e49895b6d5aa6f8. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:33:21.383342 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-8bdee736-9835-460e-8163-7f9d4aa88de0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Getting quotas for user 37e7fecdaae94842b6917152fb7f1598 and project 4501489e56744cf98e49895b6d5aa6f8. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:33:21.422236 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8bdee736-9835-460e-8163-7f9d4aa88de0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.081694 Jul 25 16:33:21.423216 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 358/752] 10.222.0.66 () {62 vars in 1200 bytes} [Mon Jul 25 16:33:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 16:33:23.921739 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2116040732", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70511969-6625-420f-86eb-299a6f40df62"}], "security_groups": [{"name": "tempest-securitygroup--1502483939"}], "key_name": "tempest-keypair-250084202", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:24.067095 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] validate_networks() for [('70511969-6625-420f-86eb-299a6f40df62', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:33:24.719518 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:33:24.720004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:33:24.720478 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:33:24.720910 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:33:24.721367 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:33:24.733382 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:24.733805 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:24.734694 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:24.735592 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:24.758602 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Getting quotas for project 4501489e56744cf98e49895b6d5aa6f8. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:33:24.764437 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Getting quotas for user 37e7fecdaae94842b6917152fb7f1598 and project 4501489e56744cf98e49895b6d5aa6f8. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:33:24.779407 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:33:24.782114 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:33:24.838745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-65f5305a-7685-4cd6-b4a8-9b943635a5a7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.922305 Jul 25 16:33:24.839426 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 395/753] 10.222.0.66 () {62 vars in 1188 bytes} [Mon Jul 25 16:33:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 16:33:24.857007 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-eebb775e-5bf4-42e0-b799-e36b47011929 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:24.858565 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-eebb775e-5bf4-42e0-b799-e36b47011929 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:24.922198 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eebb775e-5bf4-42e0-b799-e36b47011929 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:24.931332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eebb775e-5bf4-42e0-b799-e36b47011929 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:24.933245 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-eebb775e-5bf4-42e0-b799-e36b47011929 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:24.934582 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-eebb775e-5bf4-42e0-b799-e36b47011929 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1281 microversion: 2.20 time: 0.083190 Jul 25 16:33:24.935168 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 359/754] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:24 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:33:25.972359 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:25.973296 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:25.981648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:25.982195 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:25.983220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:25.983713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:26.068571 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:26.114393 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:26.116615 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:26.117832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9459f4e8-5144-4e65-9e07-78785dc7596c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1341 microversion: 2.20 time: 0.150450 Jul 25 16:33:26.121395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 396/755] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:25 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1341 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:27.159008 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:27.159793 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:27.169038 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.169636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.170679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.171109 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.360124 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:27.376998 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:27.379284 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:27.380535 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e5c4c3b7-eba0-4588-a452-86ca3d2ff476 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1407 microversion: 2.20 time: 0.226837 Jul 25 16:33:27.381118 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 360/756] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:27 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:33:27.403625 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1c66a0f4-8366-40bb-a11d-3ae0218ca65d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:27.404360 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1c66a0f4-8366-40bb-a11d-3ae0218ca65d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:27.411388 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c66a0f4-8366-40bb-a11d-3ae0218ca65d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.411921 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c66a0f4-8366-40bb-a11d-3ae0218ca65d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.412771 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c66a0f4-8366-40bb-a11d-3ae0218ca65d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.413969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1c66a0f4-8366-40bb-a11d-3ae0218ca65d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.449351 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1c66a0f4-8366-40bb-a11d-3ae0218ca65d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:33:27.563606 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1c66a0f4-8366-40bb-a11d-3ae0218ca65d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 204 len: 0 microversion: 2.1 time: 0.163723 Jul 25 16:33:27.564255 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 397/757] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:33:27 2022] DELETE /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:33:27.573941 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-24a83b32-1fab-4649-a1e4-ead289d7f8fe tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:27.574525 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-24a83b32-1fab-4649-a1e4-ead289d7f8fe tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:27.581827 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24a83b32-1fab-4649-a1e4-ead289d7f8fe tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.582762 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24a83b32-1fab-4649-a1e4-ead289d7f8fe tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.583701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24a83b32-1fab-4649-a1e4-ead289d7f8fe tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:27.584162 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-24a83b32-1fab-4649-a1e4-ead289d7f8fe tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:27.816608 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-24a83b32-1fab-4649-a1e4-ead289d7f8fe tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:27.827631 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-24a83b32-1fab-4649-a1e4-ead289d7f8fe tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1578 microversion: 2.1 time: 0.258358 Jul 25 16:33:27.828531 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 361/758] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:27 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1578 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:28.052890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-46d70856-20a6-47bb-88e6-a3558c49421a req-93aa9298-dee4-4d23-a24e-f57c5590cd17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6", "tag": "567c5e1f-440f-4238-a0c4-7abbd6b3c53f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:28.066303 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-46d70856-20a6-47bb-88e6-a3558c49421a req-93aa9298-dee4-4d23-a24e-f57c5590cd17 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:28.066737 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-46d70856-20a6-47bb-88e6-a3558c49421a req-93aa9298-dee4-4d23-a24e-f57c5590cd17 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:28.085426 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-46d70856-20a6-47bb-88e6-a3558c49421a req-93aa9298-dee4-4d23-a24e-f57c5590cd17 service nova] Creating event network-changed:567c5e1f-440f-4238-a0c4-7abbd6b3c53f for instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 on hv-cinder-83697 Jul 25 16:33:28.093507 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-46d70856-20a6-47bb-88e6-a3558c49421a req-93aa9298-dee4-4d23-a24e-f57c5590cd17 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046595 Jul 25 16:33:28.095682 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 398/759] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:28.407530 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:28.408496 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:28.416366 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:28.416805 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:28.417696 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:28.418135 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:28.584655 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:28.598569 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:28.601911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:28.604531 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-db3e24c2-ffdb-436a-a01b-384f05a7a4bc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1407 microversion: 2.20 time: 0.201404 Jul 25 16:33:28.605608 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 362/760] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:28 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:28.857616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4fdb1ca6-19a9-4021-942a-9643ae7efc99 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:28.858418 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4fdb1ca6-19a9-4021-942a-9643ae7efc99 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:28.867672 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fdb1ca6-19a9-4021-942a-9643ae7efc99 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:28.868636 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fdb1ca6-19a9-4021-942a-9643ae7efc99 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:28.869226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fdb1ca6-19a9-4021-942a-9643ae7efc99 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:28.869966 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4fdb1ca6-19a9-4021-942a-9643ae7efc99 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:29.059831 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4fdb1ca6-19a9-4021-942a-9643ae7efc99 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:29.072380 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4fdb1ca6-19a9-4021-942a-9643ae7efc99 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1578 microversion: 2.1 time: 0.220810 Jul 25 16:33:29.086069 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 399/761] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:28 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:29.641389 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:29.642482 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:29.655175 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:29.655946 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:29.657280 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:29.658073 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:29.859447 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:29.875367 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:29.878724 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:29.880670 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-139478b9-2b5f-413b-90cf-c080cf40abd8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1407 microversion: 2.20 time: 0.247389 Jul 25 16:33:29.881584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 363/762] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:29 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:30.101775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-99dec8ea-682f-45ff-a005-39f1a52bec83 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:30.102965 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-99dec8ea-682f-45ff-a005-39f1a52bec83 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:30.114140 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99dec8ea-682f-45ff-a005-39f1a52bec83 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:30.114669 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99dec8ea-682f-45ff-a005-39f1a52bec83 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:30.115567 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99dec8ea-682f-45ff-a005-39f1a52bec83 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:30.116048 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99dec8ea-682f-45ff-a005-39f1a52bec83 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:30.222074 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-99dec8ea-682f-45ff-a005-39f1a52bec83 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:30.236908 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-99dec8ea-682f-45ff-a005-39f1a52bec83 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1511 microversion: 2.1 time: 0.141246 Jul 25 16:33:30.238167 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 400/763] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:30 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1511 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:30.810648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-12c77c79-89e9-46d7-a1c1-b653d279eb22 req-29cd3a49-a8c6-4433-8a74-004c2c075be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8757e6e3-9388-4e11-9060-a1e8b7e2192a", "name": "network-vif-deleted", "tag": "ba67a122-49be-4a38-b52a-c75066e7b265"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:30.837646 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-12c77c79-89e9-46d7-a1c1-b653d279eb22 req-29cd3a49-a8c6-4433-8a74-004c2c075be2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:30.838179 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-12c77c79-89e9-46d7-a1c1-b653d279eb22 req-29cd3a49-a8c6-4433-8a74-004c2c075be2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:30.852366 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-12c77c79-89e9-46d7-a1c1-b653d279eb22 req-29cd3a49-a8c6-4433-8a74-004c2c075be2 service nova] Creating event network-vif-deleted:ba67a122-49be-4a38-b52a-c75066e7b265 for instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a on hv-cinder-83697 Jul 25 16:33:30.858642 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-12c77c79-89e9-46d7-a1c1-b653d279eb22 req-29cd3a49-a8c6-4433-8a74-004c2c075be2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057541 Jul 25 16:33:30.859353 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 364/764] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:30.910419 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:30.911352 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:30.923309 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:30.924490 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:30.925642 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:30.926302 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:31.141169 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:31.156748 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:31.159947 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:31.162801 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8c7f8e00-c841-437e-b0d9-7f3fe6bcdd61 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1407 microversion: 2.20 time: 0.259425 Jul 25 16:33:31.164037 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 401/765] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:30 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:31.268713 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:31.269960 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:31.281076 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:31.281901 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:31.283339 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:31.284121 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:31.343746 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:31.344556 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:31.345649 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lazy-loading 'fault' on Instance uuid 8757e6e3-9388-4e11-9060-a1e8b7e2192a {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:33:31.411940 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:31.423577 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c42be4fc-a8ae-407b-aaff-f4f71d79bbd4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 200 len: 1230 microversion: 2.1 time: 0.161566 Jul 25 16:33:31.425290 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 365/766] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:31 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 1230 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:32.192829 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:32.193736 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:32.201186 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:32.201745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:32.202602 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:32.203085 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:32.428935 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:32.453899 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:32.457382 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:32.458303 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:32.458742 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:32.459909 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5ba5dc53-7e0f-46ba-b6be-37839319dc68 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1407 microversion: 2.20 time: 0.273978 Jul 25 16:33:32.461856 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 402/767] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:32 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:32.472285 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:32.474026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:32.475412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:32.476177 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:32.504840 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] HTTP exception thrown: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Request method failure captured: Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a HTTP/1.1 Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sUuR8gjMYGrz6BMvzyUCInOpq0sePI-03iNk8KIAssGS_g50O29c7-wqrIBMkDxVjcQ8x1HXW4q4yyxm8a2u1uVouqXRYNC4gFcUNPL2ndnYcNywGKUAaFnX5xg_zMpS7BvtDgdyMLZ3LVII5v9LoKIXjV4PSsSLQo0WZYSSUa2hJM Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:33:32.508364 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ee2c762eec4646afbd0ea4d71a58894d"}]}] Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-350844036 Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: d3eebc82ce654013998f58585c123a0e Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:33:32.511181 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '8757e6e3-9388-4e11-9060-a1e8b7e2192a'} Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:33:32.512770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:33:32.515861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:33:32.518426 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Returning 404 to user: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:33:32.518426 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7e4f3cec-c4e2-4bc0-a357-e4b61b071710 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 404 len: 111 microversion: 2.1 time: 0.057967 Jul 25 16:33:32.518426 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 366/768] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:32 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:33:32.639982 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-960975002", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241383450", "security_groups": [{"name": "tempest-secgroup-smoke-487919838"}], "block_device_mapping_v2": [{"uuid": "ccfafa25-b3c4-475c-aac4-499a3c5370fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5179c8ca-857c-4cbe-a31d-a95e81512509"}]}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:32.854501 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] validate_networks() for [('5179c8ca-857c-4cbe-a31d-a95e81512509', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:33:33.363638 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:33:33.364827 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:33:33.365686 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:33:33.366319 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:33:33.367192 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:33:33.383043 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:33.383870 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:33.385413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:33.386120 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:33.422817 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Getting quotas for project ee2c762eec4646afbd0ea4d71a58894d. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:33:33.431675 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Getting quotas for user d3eebc82ce654013998f58585c123a0e and project ee2c762eec4646afbd0ea4d71a58894d. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:33:33.497142 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:33.498143 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:33.506303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:33.507017 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:33.508228 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:33.508770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:33.526561 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:33:33.529115 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ccfafa25-b3c4-475c-aac4-499a3c5370fb',volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:33:33.718175 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-048404eb-8566-4132-a365-49ca67c4c026 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.083969 Jul 25 16:33:33.719293 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 403/769] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:33:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:33:33.726878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:33.737140 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:33.738944 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0935d731-1cde-477d-94f1-dd55224e6b6e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:33.739652 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:33.740066 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0935d731-1cde-477d-94f1-dd55224e6b6e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:33.740910 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23cbc564-0089-4366-bd7e-03a337763467 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1407 microversion: 2.20 time: 0.249101 Jul 25 16:33:33.741664 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 367/770] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:33 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:33.814581 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0935d731-1cde-477d-94f1-dd55224e6b6e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:33.830421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0935d731-1cde-477d-94f1-dd55224e6b6e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1093 microversion: 2.1 time: 0.098756 Jul 25 16:33:33.831615 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 404/771] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:33 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1093 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:34.473600 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-bb3f935f-3f9f-408a-a825-baf542783c87 req-eb79c799-1eb0-41a1-838a-0aa6e3d6b317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6", "name": "network-vif-plugged", "status": "completed", "tag": "567c5e1f-440f-4238-a0c4-7abbd6b3c53f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:34.493210 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bb3f935f-3f9f-408a-a825-baf542783c87 req-eb79c799-1eb0-41a1-838a-0aa6e3d6b317 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:34.494505 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-bb3f935f-3f9f-408a-a825-baf542783c87 req-eb79c799-1eb0-41a1-838a-0aa6e3d6b317 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:34.519823 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-bb3f935f-3f9f-408a-a825-baf542783c87 req-eb79c799-1eb0-41a1-838a-0aa6e3d6b317 service nova] Creating event network-vif-plugged:567c5e1f-440f-4238-a0c4-7abbd6b3c53f for instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 on hv-cinder-83697 Jul 25 16:33:34.530806 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-bb3f935f-3f9f-408a-a825-baf542783c87 req-eb79c799-1eb0-41a1-838a-0aa6e3d6b317 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064463 Jul 25 16:33:34.532089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 368/772] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:33:34.775813 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:34.776762 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:34.785315 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:34.785927 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:34.786884 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:34.787454 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:34.866279 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cbeb67d6-b38d-4a40-ac07-0a5fbf9a7c3a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:34.869145 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cbeb67d6-b38d-4a40-ac07-0a5fbf9a7c3a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:34.884457 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbeb67d6-b38d-4a40-ac07-0a5fbf9a7c3a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:34.885733 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbeb67d6-b38d-4a40-ac07-0a5fbf9a7c3a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:34.887395 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbeb67d6-b38d-4a40-ac07-0a5fbf9a7c3a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:34.888667 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbeb67d6-b38d-4a40-ac07-0a5fbf9a7c3a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:34.929759 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:35.038586 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cbeb67d6-b38d-4a40-ac07-0a5fbf9a7c3a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:35.039213 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:35.051292 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:35.053138 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:35.054645 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-dcae0f5f-2e6a-43fa-a285-e483e65c4a9e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1407 microversion: 2.20 time: 0.283257 Jul 25 16:33:35.055138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cbeb67d6-b38d-4a40-ac07-0a5fbf9a7c3a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1191 microversion: 2.1 time: 0.199595 Jul 25 16:33:35.057441 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 369/773] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:34 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1191 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:35.058400 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 405/774] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:34 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:36.089227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:36.090853 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:36.095412 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-546c0fb5-52ac-4614-beee-82495b5d294e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:36.096490 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-546c0fb5-52ac-4614-beee-82495b5d294e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:36.106342 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:36.107500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-546c0fb5-52ac-4614-beee-82495b5d294e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:36.107932 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:36.108354 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-546c0fb5-52ac-4614-beee-82495b5d294e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:36.109508 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-546c0fb5-52ac-4614-beee-82495b5d294e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:36.109716 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:36.110552 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-546c0fb5-52ac-4614-beee-82495b5d294e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:36.112316 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:36.267716 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-546c0fb5-52ac-4614-beee-82495b5d294e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:36.275973 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:36.285784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-546c0fb5-52ac-4614-beee-82495b5d294e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1197 microversion: 2.1 time: 0.196561 Jul 25 16:33:36.287058 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 406/775] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:36 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:36.372994 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:36.390508 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:36.393696 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:36.395999 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0cfa67e6-0cd0-407f-ab8a-4c5b80296f54 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1407 microversion: 2.20 time: 0.317631 Jul 25 16:33:36.396979 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 370/776] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:36 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:33:37.317916 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-95b9ed2c-800c-41c4-9f7c-d9ae06ef50e4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:37.318862 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-95b9ed2c-800c-41c4-9f7c-d9ae06ef50e4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:37.325981 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95b9ed2c-800c-41c4-9f7c-d9ae06ef50e4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:37.326419 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95b9ed2c-800c-41c4-9f7c-d9ae06ef50e4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:37.327467 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95b9ed2c-800c-41c4-9f7c-d9ae06ef50e4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:37.327906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-95b9ed2c-800c-41c4-9f7c-d9ae06ef50e4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:37.431879 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:37.431879 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:37.442131 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:37.443032 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:37.444448 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:37.445218 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:37.685602 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-95b9ed2c-800c-41c4-9f7c-d9ae06ef50e4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:37.703457 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-95b9ed2c-800c-41c4-9f7c-d9ae06ef50e4 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.390028 Jul 25 16:33:37.721488 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 407/777] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:37 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:37.786515 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:37.804559 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:37.807900 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:37.810441 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c2ff1564-24e6-4375-84d8-b84ca5c4d880 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1599 microversion: 2.20 time: 0.389837 Jul 25 16:33:37.833545 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 371/778] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:33:37 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1599 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:33:37.854901 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fa0a5fb0-d165-410c-a598-9e63deac865a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:37.855969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-fa0a5fb0-d165-410c-a598-9e63deac865a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:37.870008 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fa0a5fb0-d165-410c-a598-9e63deac865a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:37.871286 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fa0a5fb0-d165-410c-a598-9e63deac865a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:37.873460 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fa0a5fb0-d165-410c-a598-9e63deac865a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:37.874491 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-fa0a5fb0-d165-410c-a598-9e63deac865a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:38.023135 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fa0a5fb0-d165-410c-a598-9e63deac865a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.178130 Jul 25 16:33:38.024369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 408/779] 10.222.0.66 () {60 vars in 1316 bytes} [Mon Jul 25 16:33:37 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:33:38.595849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-cb411da7-e632-4d80-9600-091d110b922b req-2f0455d5-cd92-41e0-9a0f-6183f2785680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b121aac-331b-4b85-b094-6591366409a6", "tag": "1d784ffa-ce5c-4955-a5dd-9e70c917f66c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:38.628746 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-cb411da7-e632-4d80-9600-091d110b922b req-2f0455d5-cd92-41e0-9a0f-6183f2785680 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:38.630058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-cb411da7-e632-4d80-9600-091d110b922b req-2f0455d5-cd92-41e0-9a0f-6183f2785680 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:38.656994 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-cb411da7-e632-4d80-9600-091d110b922b req-2f0455d5-cd92-41e0-9a0f-6183f2785680 service nova] Creating event network-changed:1d784ffa-ce5c-4955-a5dd-9e70c917f66c for instance 1b121aac-331b-4b85-b094-6591366409a6 on hv-cinder-83697 Jul 25 16:33:38.669985 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-cb411da7-e632-4d80-9600-091d110b922b req-2f0455d5-cd92-41e0-9a0f-6183f2785680 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088388 Jul 25 16:33:38.673884 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 372/780] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:38.735705 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f7316ab7-c2dd-4420-ad22-fd6ff1aa394a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:38.738551 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f7316ab7-c2dd-4420-ad22-fd6ff1aa394a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:38.751656 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7316ab7-c2dd-4420-ad22-fd6ff1aa394a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:38.752893 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7316ab7-c2dd-4420-ad22-fd6ff1aa394a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:38.754702 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7316ab7-c2dd-4420-ad22-fd6ff1aa394a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:38.756947 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f7316ab7-c2dd-4420-ad22-fd6ff1aa394a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:38.926984 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8d051b48-efdc-4405-91db-db2d587b0906 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:38.928055 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8d051b48-efdc-4405-91db-db2d587b0906 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:38.943678 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d051b48-efdc-4405-91db-db2d587b0906 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:38.944605 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d051b48-efdc-4405-91db-db2d587b0906 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:38.945761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d051b48-efdc-4405-91db-db2d587b0906 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:38.946648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8d051b48-efdc-4405-91db-db2d587b0906 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:39.019435 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8d051b48-efdc-4405-91db-db2d587b0906 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:33:39.023936 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:39.228375 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8d051b48-efdc-4405-91db-db2d587b0906 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 204 len: 0 microversion: 2.1 time: 0.305942 Jul 25 16:33:39.237182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 373/781] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:33:38 2022] DELETE /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:33:39.247975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bcc85a67-eecb-4905-8f54-ffba49a5136a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:39.249268 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bcc85a67-eecb-4905-8f54-ffba49a5136a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:39.262018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc85a67-eecb-4905-8f54-ffba49a5136a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:39.262779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc85a67-eecb-4905-8f54-ffba49a5136a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:39.264372 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc85a67-eecb-4905-8f54-ffba49a5136a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:39.265178 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bcc85a67-eecb-4905-8f54-ffba49a5136a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:39.680677 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f7316ab7-c2dd-4420-ad22-fd6ff1aa394a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:39.697126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f7316ab7-c2dd-4420-ad22-fd6ff1aa394a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.970868 Jul 25 16:33:39.698592 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 409/782] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:38 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:39.759301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-bcc85a67-eecb-4905-8f54-ffba49a5136a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:39.768131 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bcc85a67-eecb-4905-8f54-ffba49a5136a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.528715 Jul 25 16:33:39.768823 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 374/783] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:39 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:40.218574 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-1bfe854e-9f84-4d08-b670-83bcee4b42d9 req-648c9817-c7b4-4c01-80eb-75c1e960d648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6", "tag": "567c5e1f-440f-4238-a0c4-7abbd6b3c53f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:40.240450 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1bfe854e-9f84-4d08-b670-83bcee4b42d9 req-648c9817-c7b4-4c01-80eb-75c1e960d648 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:40.241687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1bfe854e-9f84-4d08-b670-83bcee4b42d9 req-648c9817-c7b4-4c01-80eb-75c1e960d648 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:40.266146 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-1bfe854e-9f84-4d08-b670-83bcee4b42d9 req-648c9817-c7b4-4c01-80eb-75c1e960d648 service nova] Creating event network-changed:567c5e1f-440f-4238-a0c4-7abbd6b3c53f for instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 on hv-cinder-83697 Jul 25 16:33:40.276743 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-1bfe854e-9f84-4d08-b670-83bcee4b42d9 req-648c9817-c7b4-4c01-80eb-75c1e960d648 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065543 Jul 25 16:33:40.278768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 410/784] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:40.704242 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-cb927731-05d5-407b-9531-320caa3f173f req-95c8e532-ba49-4830-8a51-2204a7939a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb", "tag": "54cf1201-fdc0-44ce-bc59-698ade1f2c99"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:40.723289 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-cb927731-05d5-407b-9531-320caa3f173f req-95c8e532-ba49-4830-8a51-2204a7939a15 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:40.724307 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-cb927731-05d5-407b-9531-320caa3f173f req-95c8e532-ba49-4830-8a51-2204a7939a15 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:40.729387 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cd007331-53d0-4c19-b875-555d8058a521 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:40.731257 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cd007331-53d0-4c19-b875-555d8058a521 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:40.745191 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd007331-53d0-4c19-b875-555d8058a521 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:40.748411 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd007331-53d0-4c19-b875-555d8058a521 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:40.750260 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd007331-53d0-4c19-b875-555d8058a521 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:40.751291 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-cd007331-53d0-4c19-b875-555d8058a521 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:40.754399 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-cb927731-05d5-407b-9531-320caa3f173f req-95c8e532-ba49-4830-8a51-2204a7939a15 service nova] Creating event network-changed:54cf1201-fdc0-44ce-bc59-698ade1f2c99 for instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb on hv-cinder-83697 Jul 25 16:33:40.765240 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-cb927731-05d5-407b-9531-320caa3f173f req-95c8e532-ba49-4830-8a51-2204a7939a15 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068388 Jul 25 16:33:40.766938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 375/785] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:40.802758 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2ac148aa-03f9-4fea-ad08-c40d2066db7a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:40.803872 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2ac148aa-03f9-4fea-ad08-c40d2066db7a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:40.819775 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ac148aa-03f9-4fea-ad08-c40d2066db7a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:40.822583 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ac148aa-03f9-4fea-ad08-c40d2066db7a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:40.824325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ac148aa-03f9-4fea-ad08-c40d2066db7a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:40.825935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-2ac148aa-03f9-4fea-ad08-c40d2066db7a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:41.456141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cd007331-53d0-4c19-b875-555d8058a521 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:41.472126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cd007331-53d0-4c19-b875-555d8058a521 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.751997 Jul 25 16:33:41.475706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 411/786] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:40 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:41.562084 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2ac148aa-03f9-4fea-ad08-c40d2066db7a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:41.580804 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2ac148aa-03f9-4fea-ad08-c40d2066db7a tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1570 microversion: 2.1 time: 0.787013 Jul 25 16:33:41.584436 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 376/787] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:40 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1570 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:42.513616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-14c53ad5-0255-4b91-98b2-1791c6c069e7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:42.515014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-14c53ad5-0255-4b91-98b2-1791c6c069e7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:42.526553 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14c53ad5-0255-4b91-98b2-1791c6c069e7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:42.527433 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14c53ad5-0255-4b91-98b2-1791c6c069e7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:42.529014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14c53ad5-0255-4b91-98b2-1791c6c069e7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:42.529736 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-14c53ad5-0255-4b91-98b2-1791c6c069e7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:42.649003 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7d621040-fbfc-4c86-91a4-4230d0b8326c tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:42.656500 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7d621040-fbfc-4c86-91a4-4230d0b8326c tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:42.671762 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d621040-fbfc-4c86-91a4-4230d0b8326c tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:42.673108 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d621040-fbfc-4c86-91a4-4230d0b8326c tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:42.675147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d621040-fbfc-4c86-91a4-4230d0b8326c tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:42.676404 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7d621040-fbfc-4c86-91a4-4230d0b8326c tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:42.845518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7d621040-fbfc-4c86-91a4-4230d0b8326c tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a52a93774cd48868f9b5656821b0f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90317adf2c86461d96439dc48441b6c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:42.872325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7d621040-fbfc-4c86-91a4-4230d0b8326c tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 200 len: 1383 microversion: 2.1 time: 0.247419 Jul 25 16:33:42.874334 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 377/788] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:42 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 1383 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:42.908330 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-14c53ad5-0255-4b91-98b2-1791c6c069e7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:42.919953 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-5ec3802e-983f-4f4a-b1ea-a3ee26f21727 req-778706e8-304b-4933-9b58-b6b2a3e82a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb", "name": "network-vif-deleted", "tag": "54cf1201-fdc0-44ce-bc59-698ade1f2c99"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:42.925303 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-14c53ad5-0255-4b91-98b2-1791c6c069e7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.419004 Jul 25 16:33:42.926727 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 412/789] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:42 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:42.944320 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5ec3802e-983f-4f4a-b1ea-a3ee26f21727 req-778706e8-304b-4933-9b58-b6b2a3e82a99 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:42.945322 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5ec3802e-983f-4f4a-b1ea-a3ee26f21727 req-778706e8-304b-4933-9b58-b6b2a3e82a99 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:42.964363 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-5ec3802e-983f-4f4a-b1ea-a3ee26f21727 req-778706e8-304b-4933-9b58-b6b2a3e82a99 service nova] Creating event network-vif-deleted:54cf1201-fdc0-44ce-bc59-698ade1f2c99 for instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb on hv-cinder-83697 Jul 25 16:33:42.971929 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-5ec3802e-983f-4f4a-b1ea-a3ee26f21727 req-778706e8-304b-4933-9b58-b6b2a3e82a99 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057657 Jul 25 16:33:42.973089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 378/790] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:33:43.913058 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:43.914231 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] [instance: e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:43.917835 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:43.919924 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=14 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:43.931582 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:43.932331 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:43.933799 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:43.934397 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:43.959564 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] HTTP exception thrown: Instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb could not be found. Jul 25 16:33:43.962193 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0808191d-49f9-4a37-98d3-e09451cb504b tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Request method failure captured: Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb HTTP/1.1 Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sS0Bg99AlUexKQZ5nMELE9ddBEdWGg6PWzijwBqun-CtZPNZ4f9_eVyuwx8qe46hNz9JQDvPlqCBABy7JWUsWsOSZIAjMkili20lcEy9m9Www15-7fNonyNH7yphkZUL9etKDG0RvYrn7UE4qdrQDnojXtDgWMkTevvcM71qKIPa2k Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 90317adf2c86461d96439dc48441b6c8 Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestShelveInstance-912265331 Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:33:43.963082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/90317adf2c86461d96439dc48441b6c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90317adf2c86461d96439dc48441b6c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90317adf2c86461d96439dc48441b6c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_90317adf2c86461d96439dc48441b6c8"}]}] Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestShelveInstance-912265331 Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 90317adf2c86461d96439dc48441b6c8 Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestShelveInstance-912265331 Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-TestShelveInstance-912265331-project Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 6a52a93774cd48868f9b5656821b0f12 Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestShelveInstance-912265331-project Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb could not be found. Jul 25 16:33:43.965889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb'} Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb could not be found. Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:33:43.967712 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb could not be found. Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb could not be found. Jul 25 16:33:43.970324 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:33:43.972734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Returning 404 to user: Instance e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:33:43.972884 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0808191d-49f9-4a37-98d3-e09451cb504b tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:43.973052 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-96daf9b0-622e-4d3c-a18d-92949ea0df15 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb" status: 404 len: 111 microversion: 2.1 time: 0.059205 Jul 25 16:33:43.973052 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 413/791] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:43 2022] GET /compute/v2.1/servers/e92fa2eb-b00f-4a5a-b0d2-07ff147bf9bb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:33:43.976195 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0808191d-49f9-4a37-98d3-e09451cb504b tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:43.977003 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0808191d-49f9-4a37-98d3-e09451cb504b tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:43.978616 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0808191d-49f9-4a37-98d3-e09451cb504b tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:43.979367 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0808191d-49f9-4a37-98d3-e09451cb504b tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:44.313823 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0808191d-49f9-4a37-98d3-e09451cb504b tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:44.326514 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0808191d-49f9-4a37-98d3-e09451cb504b tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.372134 Jul 25 16:33:44.327157 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 379/792] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:43 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:44.384506 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b0000dc8-bd33-41a2-904c-7ff24cc1eb70 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] Calling method '.version_select at 0x7f440a665d30>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:44.401576 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:44.427841 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b0000dc8-bd33-41a2-904c-7ff24cc1eb70 tempest-TestShelveInstance-912265331 tempest-TestShelveInstance-912265331-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1916605538" status: 202 len: 0 microversion: 2.1 time: 0.050634 Jul 25 16:33:44.428451 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 414/793] 10.222.0.66 () {58 vars in 1254 bytes} [Mon Jul 25 16:33:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1916605538 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:33:45.358312 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-407b8399-941c-4b25-8fe6-ab585ad1005e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:45.359689 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-407b8399-941c-4b25-8fe6-ab585ad1005e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:45.369370 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:33:45.399078 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-407b8399-941c-4b25-8fe6-ab585ad1005e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:45.401868 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-407b8399-941c-4b25-8fe6-ab585ad1005e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:45.404077 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-407b8399-941c-4b25-8fe6-ab585ad1005e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:45.404797 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-407b8399-941c-4b25-8fe6-ab585ad1005e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:45.841614 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-407b8399-941c-4b25-8fe6-ab585ad1005e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:45.856795 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-407b8399-941c-4b25-8fe6-ab585ad1005e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.507708 Jul 25 16:33:45.859864 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 380/794] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:45 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:46.899014 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4935356b-1cfd-4b99-b098-4e530cd292b3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:46.900036 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4935356b-1cfd-4b99-b098-4e530cd292b3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:46.914821 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4935356b-1cfd-4b99-b098-4e530cd292b3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:46.915580 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4935356b-1cfd-4b99-b098-4e530cd292b3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:46.916934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4935356b-1cfd-4b99-b098-4e530cd292b3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:46.917695 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4935356b-1cfd-4b99-b098-4e530cd292b3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:47.206377 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4935356b-1cfd-4b99-b098-4e530cd292b3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:47.216762 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4935356b-1cfd-4b99-b098-4e530cd292b3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.326983 Jul 25 16:33:47.217720 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 415/795] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:46 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:48.242061 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9e2e5dd0-77a3-4002-9494-ef04ed15f10e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:48.243519 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9e2e5dd0-77a3-4002-9494-ef04ed15f10e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:48.252341 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e2e5dd0-77a3-4002-9494-ef04ed15f10e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:48.253214 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e2e5dd0-77a3-4002-9494-ef04ed15f10e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:48.254338 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e2e5dd0-77a3-4002-9494-ef04ed15f10e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:48.255047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9e2e5dd0-77a3-4002-9494-ef04ed15f10e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:48.765082 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9e2e5dd0-77a3-4002-9494-ef04ed15f10e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:48.780778 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9e2e5dd0-77a3-4002-9494-ef04ed15f10e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.544827 Jul 25 16:33:48.799303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 381/796] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:48 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:33:49.810957 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-47276d95-7047-44f6-8380-e7b32075ce62 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:49.812922 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-47276d95-7047-44f6-8380-e7b32075ce62 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:49.823198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-47276d95-7047-44f6-8380-e7b32075ce62 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:49.824265 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-47276d95-7047-44f6-8380-e7b32075ce62 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:49.825804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-47276d95-7047-44f6-8380-e7b32075ce62 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:49.826794 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-47276d95-7047-44f6-8380-e7b32075ce62 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:50.166198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-47276d95-7047-44f6-8380-e7b32075ce62 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:50.184980 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-47276d95-7047-44f6-8380-e7b32075ce62 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.380491 Jul 25 16:33:50.195060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 416/797] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:49 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:50.579109 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-34405ed7-f76a-4568-b2bd-7d699514bcb8 req-dd67d229-8db2-4b2a-85f4-69647a0b6320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b121aac-331b-4b85-b094-6591366409a6", "name": "network-vif-plugged", "status": "completed", "tag": "1d784ffa-ce5c-4955-a5dd-9e70c917f66c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:50.592949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-34405ed7-f76a-4568-b2bd-7d699514bcb8 req-dd67d229-8db2-4b2a-85f4-69647a0b6320 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:50.593473 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-34405ed7-f76a-4568-b2bd-7d699514bcb8 req-dd67d229-8db2-4b2a-85f4-69647a0b6320 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:50.615037 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-34405ed7-f76a-4568-b2bd-7d699514bcb8 req-dd67d229-8db2-4b2a-85f4-69647a0b6320 service nova] Creating event network-vif-plugged:1d784ffa-ce5c-4955-a5dd-9e70c917f66c for instance 1b121aac-331b-4b85-b094-6591366409a6 on hv-cinder-83697 Jul 25 16:33:50.624793 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-34405ed7-f76a-4568-b2bd-7d699514bcb8 req-dd67d229-8db2-4b2a-85f4-69647a0b6320 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049933 Jul 25 16:33:50.626087 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 382/798] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:33:51.224748 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7433f200-5e8a-44b8-bb05-12356e688c63 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:51.226046 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7433f200-5e8a-44b8-bb05-12356e688c63 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:51.239619 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7433f200-5e8a-44b8-bb05-12356e688c63 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:51.240272 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7433f200-5e8a-44b8-bb05-12356e688c63 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:51.241822 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7433f200-5e8a-44b8-bb05-12356e688c63 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:51.242555 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7433f200-5e8a-44b8-bb05-12356e688c63 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:51.486554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7433f200-5e8a-44b8-bb05-12356e688c63 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:51.497421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7433f200-5e8a-44b8-bb05-12356e688c63 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1264 microversion: 2.1 time: 0.279744 Jul 25 16:33:51.498456 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 417/799] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:51 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1264 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:52.555020 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ef95729c-4382-482d-aa1e-85ee26450719 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:52.562311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ef95729c-4382-482d-aa1e-85ee26450719 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:52.578754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef95729c-4382-482d-aa1e-85ee26450719 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:52.579641 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef95729c-4382-482d-aa1e-85ee26450719 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:52.581153 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef95729c-4382-482d-aa1e-85ee26450719 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:52.582024 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ef95729c-4382-482d-aa1e-85ee26450719 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:52.920728 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ef95729c-4382-482d-aa1e-85ee26450719 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:52.938438 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ef95729c-4382-482d-aa1e-85ee26450719 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1452 microversion: 2.1 time: 0.409198 Jul 25 16:33:52.939948 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 383/800] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:52 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1452 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:52.970608 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-49fd4182-e6c4-4e21-bf19-3c67eac188a2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:33:52.972126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-49fd4182-e6c4-4e21-bf19-3c67eac188a2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:33:52.982595 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-49fd4182-e6c4-4e21-bf19-3c67eac188a2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:52.983341 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-49fd4182-e6c4-4e21-bf19-3c67eac188a2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:52.986090 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-49fd4182-e6c4-4e21-bf19-3c67eac188a2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:52.986090 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-49fd4182-e6c4-4e21-bf19-3c67eac188a2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:53.333068 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-49fd4182-e6c4-4e21-bf19-3c67eac188a2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:33:53.347991 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-49fd4182-e6c4-4e21-bf19-3c67eac188a2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1452 microversion: 2.1 time: 0.381871 Jul 25 16:33:53.350282 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 418/801] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:33:52 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1452 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:33:57.419952 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-f16e06e7-00f2-4d3e-a4a8-466d904afb7d req-0b191dc8-92da-4b9e-91e2-1da3746f0a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b121aac-331b-4b85-b094-6591366409a6", "tag": "1d784ffa-ce5c-4955-a5dd-9e70c917f66c"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:33:57.444562 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f16e06e7-00f2-4d3e-a4a8-466d904afb7d req-0b191dc8-92da-4b9e-91e2-1da3746f0a99 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:33:57.446562 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-f16e06e7-00f2-4d3e-a4a8-466d904afb7d req-0b191dc8-92da-4b9e-91e2-1da3746f0a99 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:33:57.470288 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-f16e06e7-00f2-4d3e-a4a8-466d904afb7d req-0b191dc8-92da-4b9e-91e2-1da3746f0a99 service nova] Creating event network-changed:1d784ffa-ce5c-4955-a5dd-9e70c917f66c for instance 1b121aac-331b-4b85-b094-6591366409a6 on hv-cinder-83697 Jul 25 16:33:57.487476 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-f16e06e7-00f2-4d3e-a4a8-466d904afb7d req-0b191dc8-92da-4b9e-91e2-1da3746f0a99 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073095 Jul 25 16:33:57.489069 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 384/802] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:13.891713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b1c0d754-2b6d-41ea-88bb-c83ac0e38fce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:13.892557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b1c0d754-2b6d-41ea-88bb-c83ac0e38fce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:13.895542 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:13.896523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=56 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:13.907022 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1c0d754-2b6d-41ea-88bb-c83ac0e38fce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:13.907543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1c0d754-2b6d-41ea-88bb-c83ac0e38fce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:13.908792 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1c0d754-2b6d-41ea-88bb-c83ac0e38fce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:13.909404 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b1c0d754-2b6d-41ea-88bb-c83ac0e38fce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:13.943034 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b1c0d754-2b6d-41ea-88bb-c83ac0e38fce tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/ips" status: 200 len: 151 microversion: 2.20 time: 0.056979 Jul 25 16:34:13.944137 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 419/803] 10.222.0.66 () {60 vars in 1289 bytes} [Mon Jul 25 16:34:13 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/ips => generated 151 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:34:15.849255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=9 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:15.850501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:15.859137 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-610f7820-1041-466d-9bf8-717040889a2c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:15.860210 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-610f7820-1041-466d-9bf8-717040889a2c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:15.874943 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-610f7820-1041-466d-9bf8-717040889a2c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:15.875645 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-610f7820-1041-466d-9bf8-717040889a2c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:15.876999 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-610f7820-1041-466d-9bf8-717040889a2c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:15.877807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-610f7820-1041-466d-9bf8-717040889a2c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:15.912713 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-610f7820-1041-466d-9bf8-717040889a2c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lazy-loading 'flavor' on Instance uuid d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:34:16.134774 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-610f7820-1041-466d-9bf8-717040889a2c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/action" status: 202 len: 0 microversion: 2.20 time: 0.287796 Jul 25 16:34:16.135425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 385/804] 10.222.0.66 () {62 vars in 1319 bytes} [Mon Jul 25 16:34:15 2022] POST /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:34:16.145262 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:16.146198 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:16.154491 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.155196 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.156373 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:16.157237 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:16.354174 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:16.363812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:16.365373 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:16.366590 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-38278eed-01c7-4e1a-86a3-9ab42678e001 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.226110 Jul 25 16:34:16.367165 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 420/805] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:16 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:17.398196 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:17.399427 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:17.412403 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:17.413188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:17.414579 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:17.415329 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:17.601893 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:17.611857 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:17.613580 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:17.614944 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-67d373a0-76aa-40cf-94f0-c38bf7bd953f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.225830 Jul 25 16:34:17.615542 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 386/806] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:17 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:18.644679 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:18.645871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:18.658162 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:18.658898 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:18.660348 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:18.661069 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:18.850814 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:18.859706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:18.861596 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:18.863424 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-bda84cbd-b1d5-4278-abca-bfcb891b460f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.225478 Jul 25 16:34:18.863751 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 421/807] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:18 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:19.900915 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:19.901665 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:19.909362 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:19.909883 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:19.910745 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:19.911315 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:20.079159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:20.092295 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:20.095379 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:20.098963 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0c41e3e5-1d00-4eab-8237-929f883c3c33 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.201949 Jul 25 16:34:20.100353 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 387/808] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:19 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:21.130787 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:21.131903 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:21.142182 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:21.142757 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:21.143966 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:21.144708 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:21.354893 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:21.368172 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:21.370876 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:21.372140 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8ed997a0-f3b4-479b-a929-a8ec22145bb6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.247332 Jul 25 16:34:21.372719 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 422/809] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:21 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:22.405393 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:22.406284 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:22.414888 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:22.415332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:22.416260 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:22.416696 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:22.626584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:22.637716 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:22.640268 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:22.642047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5adb158c-3e06-4cb7-afa0-f3db2e6ca2dc tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.242105 Jul 25 16:34:22.642659 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 388/810] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:22 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:23.683793 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:23.685516 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:23.702402 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:23.702699 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:23.703898 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:23.704826 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:24.152618 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:24.162126 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:24.163868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:24.165227 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3dd4909a-5ace-4dab-9900-d2e4c340856e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.486197 Jul 25 16:34:24.165756 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 423/811] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:23 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:25.193455 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:25.194490 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:25.206540 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:25.207283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:25.208817 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:25.209772 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:25.394063 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:25.403902 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:25.406298 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:25.407685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b6046467-4230-46bb-a5ad-8770a2b2f8fa tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.221705 Jul 25 16:34:25.409062 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 389/812] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:25 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:26.436396 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:26.437673 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:26.448745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:26.449499 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:26.450872 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:26.451377 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:26.599636 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:26.608741 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:26.610406 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:26.612101 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a30339a4-68f5-46a5-9a2d-e4396e823eac tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.183087 Jul 25 16:34:26.612672 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 424/813] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:26 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:27.640074 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:27.640074 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:27.649721 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:27.650523 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:27.651884 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:27.652637 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:27.904277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:27.920691 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:27.924519 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:27.926907 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f8d8cb24-38ff-4671-a595-3601c560c5ae tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.293025 Jul 25 16:34:27.927966 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 390/814] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:27 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:28.969189 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:28.969910 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:28.987049 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:28.987708 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:28.988683 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:28.989233 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:29.182468 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:29.191973 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:29.193544 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:29.194771 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-644d4c26-5f27-4358-9bd1-be76369029fe tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.230071 Jul 25 16:34:29.195358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 425/815] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:28 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:30.220358 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:30.221036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:30.228332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:30.228764 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:30.229578 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:30.230016 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:30.437744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:30.447970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:30.449816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:30.451204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7ced8c0d-170f-4ae8-a5c4-3b018a6eda62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.235023 Jul 25 16:34:30.451923 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 391/816] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:30 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:31.478488 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:31.479215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:31.487953 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:31.488638 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:31.489533 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:31.490003 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:31.665451 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:31.679766 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:31.682640 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:31.684022 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-89d5ec1f-038a-4c54-8b02-1529954f2718 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.210761 Jul 25 16:34:31.684601 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 426/817] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:31 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:32.726459 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:32.727840 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:32.741260 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:32.742345 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:32.743981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:32.744753 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:32.955506 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:32.975569 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:32.978441 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:32.980511 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23c769dd-c702-408b-9be7-0685709c886c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1744 microversion: 2.20 time: 0.262178 Jul 25 16:34:32.981412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 392/818] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:32 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1744 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:34.008964 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:34.009837 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:34.020569 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:34.021321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:34.022668 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:34.023282 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:34.165684 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:34:34.166277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Mon Jul 25 16:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:34:34.189586 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:34.199389 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:34.201894 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:34.203409 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a4e40fb8-3d4e-4369-af84-5ee7a9a48578 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1739 microversion: 2.20 time: 0.200893 Jul 25 16:34:34.204098 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 427/819] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:34 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:34.817609 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-87555b61-7666-4f7d-82b6-3d2ebb311d96 req-d1aa5856-6fc6-404d-8255-9459b1111c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6", "name": "network-vif-plugged", "status": "completed", "tag": "567c5e1f-440f-4238-a0c4-7abbd6b3c53f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:34.836951 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-87555b61-7666-4f7d-82b6-3d2ebb311d96 req-d1aa5856-6fc6-404d-8255-9459b1111c24 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:34.838289 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-87555b61-7666-4f7d-82b6-3d2ebb311d96 req-d1aa5856-6fc6-404d-8255-9459b1111c24 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:34.863160 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-87555b61-7666-4f7d-82b6-3d2ebb311d96 req-d1aa5856-6fc6-404d-8255-9459b1111c24 service nova] Creating event network-vif-plugged:567c5e1f-440f-4238-a0c4-7abbd6b3c53f for instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 on hv-cinder-83697 Jul 25 16:34:34.873255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-87555b61-7666-4f7d-82b6-3d2ebb311d96 req-d1aa5856-6fc6-404d-8255-9459b1111c24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062065 Jul 25 16:34:34.876661 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 393/820] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:34:35.234646 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:35.238890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:35.256687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:35.257884 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:35.259305 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:35.260043 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:35.522603 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:35.538330 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:35.540320 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:35.541920 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2ee76fa9-46b1-42c8-a504-9ac7190f5a0c tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1739 microversion: 2.20 time: 0.313687 Jul 25 16:34:35.543151 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 428/821] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:35 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:36.579390 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:36.580333 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:36.602368 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:36.602984 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:36.603877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:36.604396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:36.784744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:36.797839 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:36.799465 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:36.800713 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3260b4a2-88a4-45bc-ac27-2739760b1e71 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1739 microversion: 2.20 time: 0.228813 Jul 25 16:34:36.813870 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 394/822] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:36 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:37.831147 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:37.832261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:37.843979 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:37.844767 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:37.845968 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:37.846412 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:38.064359 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:38.077554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:38.080878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:38.083484 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c9529529-f4b2-4018-bd31-3014199bdaf6 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1739 microversion: 2.20 time: 0.259103 Jul 25 16:34:38.085079 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 429/823] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:37 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:39.120931 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:39.121865 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:39.132401 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:39.133031 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:39.134396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:39.135290 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:39.371451 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:39.393067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:39.397128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:39.400675 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-11e7a3bc-d692-4221-a208-c258303226c3 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1739 microversion: 2.20 time: 0.285460 Jul 25 16:34:39.401503 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 395/824] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:39 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:40.434153 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:40.434840 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:40.442297 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:40.443113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:40.444319 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:40.445006 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:40.622794 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:40.637292 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:40.639968 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:40.641568 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-68088bcd-83e6-46f3-865c-8c64c26cfce5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1739 microversion: 2.20 time: 0.211386 Jul 25 16:34:40.642531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 430/825] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:40 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:41.678293 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:41.679370 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:41.689846 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:41.690629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:41.692035 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:41.692707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:41.911935 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:41.931706 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:41.933773 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:41.935362 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-02e95635-d93c-4bb8-82fd-71964ab112a2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1739 microversion: 2.20 time: 0.263413 Jul 25 16:34:41.936517 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 396/826] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:41 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:42.979326 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:42.982104 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:42.995241 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:42.996099 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:42.997591 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:42.998445 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:43.191239 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:43.201784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:43.203787 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:43.205150 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4dc008ad-c5cc-4529-b43b-ad88bb4b1557 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1739 microversion: 2.20 time: 0.233064 Jul 25 16:34:43.206343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 431/827] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:42 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:44.234717 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:44.236068 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:44.249886 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:44.250968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:44.252119 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:44.253109 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:44.448158 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:44.463100 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:44.466024 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:44.468140 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a73e4254-7a83-4928-bd53-9c60e43c292b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1739 microversion: 2.20 time: 0.240444 Jul 25 16:34:44.469071 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 397/828] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:44 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:45.498738 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:45.499618 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:45.505487 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=27 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:45.512351 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:45.512871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:45.513917 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:45.514469 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:45.521547 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=77 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:45.713469 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:45.728052 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:45.730009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:45.731554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f9df494b-4446-4683-87f6-5e6c8eec115e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1721 microversion: 2.20 time: 0.238779 Jul 25 16:34:45.732461 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 432/829] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:45 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:46.756597 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:46.757325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:46.759909 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=27 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:46.766535 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.767105 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.767736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:46.768151 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:46.771501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:34:46.952501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:46.961586 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:46.963030 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:46.964258 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-054c998d-a213-4c01-9807-c59aeaec9845 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1721 microversion: 2.20 time: 0.212033 Jul 25 16:34:46.964836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 398/830] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:46 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:48.002178 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:48.003001 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:48.010099 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:48.010564 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:48.011427 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:48.011856 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:48.173672 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:48.182987 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:48.184558 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:48.185929 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ec2a2c3c-bb7b-4251-8645-b3e28548417f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1664 microversion: 2.20 time: 0.187884 Jul 25 16:34:48.186775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 433/831] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:47 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1664 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:48.212251 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-04f4da67-95e7-49d5-b4bc-b169365918d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24a545cb-03b5-45da-a67a-5676197685f9"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:48.214753 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-04f4da67-95e7-49d5-b4bc-b169365918d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:48.222762 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04f4da67-95e7-49d5-b4bc-b169365918d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:48.223257 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04f4da67-95e7-49d5-b4bc-b169365918d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:48.224417 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04f4da67-95e7-49d5-b4bc-b169365918d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:48.224956 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-04f4da67-95e7-49d5-b4bc-b169365918d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:48.574101 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-04f4da67-95e7-49d5-b4bc-b169365918d0 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.366339 Jul 25 16:34:48.575345 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 399/832] 10.222.0.66 () {62 vars in 1364 bytes} [Mon Jul 25 16:34:48 2022] POST /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/os-volume_attachments => generated 188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 16:34:48.775309 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5d6a3d5e-4ecc-42d5-964c-bc0bc60cce6a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:48.776063 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5d6a3d5e-4ecc-42d5-964c-bc0bc60cce6a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:48.784941 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d6a3d5e-4ecc-42d5-964c-bc0bc60cce6a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:48.785506 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d6a3d5e-4ecc-42d5-964c-bc0bc60cce6a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:48.786884 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d6a3d5e-4ecc-42d5-964c-bc0bc60cce6a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:48.787520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5d6a3d5e-4ecc-42d5-964c-bc0bc60cce6a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:48.915807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-5c0095c8-ff36-42c3-9057-b5925123f06e req-c3733624-aab6-4cec-b36c-4eb18b2395ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6", "name": "network-vif-unplugged", "status": "completed", "tag": "567c5e1f-440f-4238-a0c4-7abbd6b3c53f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:48.935193 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5c0095c8-ff36-42c3-9057-b5925123f06e req-c3733624-aab6-4cec-b36c-4eb18b2395ee service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:48.935944 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-5c0095c8-ff36-42c3-9057-b5925123f06e req-c3733624-aab6-4cec-b36c-4eb18b2395ee service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:48.952899 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.compute.server_external_events [req-5c0095c8-ff36-42c3-9057-b5925123f06e req-c3733624-aab6-4cec-b36c-4eb18b2395ee service nova] Unable to find a host for instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6. Dropping event network-vif-unplugged {{(pid=117920) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 16:34:48.953978 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-5c0095c8-ff36-42c3-9057-b5925123f06e req-c3733624-aab6-4cec-b36c-4eb18b2395ee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045616 Jul 25 16:34:48.954971 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 400/833] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 16:34:49.118478 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5d6a3d5e-4ecc-42d5-964c-bc0bc60cce6a tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/os-volume_attachments/24a545cb-03b5-45da-a67a-5676197685f9" status: 202 len: 0 microversion: 2.20 time: 0.349129 Jul 25 16:34:49.119214 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 434/834] 10.222.0.66 () {60 vars in 1457 bytes} [Mon Jul 25 16:34:48 2022] DELETE /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/os-volume_attachments/24a545cb-03b5-45da-a67a-5676197685f9 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:34:49.184313 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6584b03b-92d1-40db-8fc3-b2277ceddd35 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:34:49.184860 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6584b03b-92d1-40db-8fc3-b2277ceddd35 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:49.191638 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6584b03b-92d1-40db-8fc3-b2277ceddd35 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:49.192113 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6584b03b-92d1-40db-8fc3-b2277ceddd35 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:49.192843 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6584b03b-92d1-40db-8fc3-b2277ceddd35 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:49.193328 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6584b03b-92d1-40db-8fc3-b2277ceddd35 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:49.285136 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6584b03b-92d1-40db-8fc3-b2277ceddd35 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "POST /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/action" status: 202 len: 0 microversion: 2.20 time: 0.105091 Jul 25 16:34:49.285917 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 401/835] 10.222.0.66 () {62 vars in 1319 bytes} [Mon Jul 25 16:34:49 2022] POST /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:34:49.296593 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:49.297144 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:49.306031 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:49.306899 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:49.308214 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:49.308855 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:49.512539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:49.521938 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:49.523452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:49.524705 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-414765b1-8d80-4a1a-940f-73ca92779e15 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1672 microversion: 2.20 time: 0.234046 Jul 25 16:34:49.525358 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 435/836] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:49 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:50.555401 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:50.556460 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:50.566958 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:50.567707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:50.568954 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:50.569746 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:50.733613 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:50.748208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:50.750867 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:50.752864 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-96f2ecdc-ca96-4e06-bdc5-7b737849be62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.204984 Jul 25 16:34:50.753849 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 402/837] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:50 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:51.790164 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:51.791047 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:51.798304 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:51.798778 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:51.799857 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:51.800088 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:52.005043 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:52.014855 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:52.016522 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:52.017783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-319cd70a-da3a-4ed3-8aef-a2b289997770 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.232314 Jul 25 16:34:52.018806 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 436/838] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:51 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:53.073894 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:53.074828 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:53.085298 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:53.086305 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:53.087433 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:53.088316 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:53.265854 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:53.276640 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:53.278938 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:53.280637 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4d97d5a7-299c-480e-882f-4c3c0e7155fb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.215836 Jul 25 16:34:53.281563 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 403/839] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:53 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:54.325531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:54.326313 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:54.334455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:54.334903 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:54.336224 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:54.336736 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:54.546002 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:54.562040 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:54.565105 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:54.567320 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-19b373f6-95b8-476f-be01-b2cfefaca146 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.248175 Jul 25 16:34:54.568309 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 437/840] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:54 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:55.597211 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:55.600635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:55.613533 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.614414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.615926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:55.616764 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:55.840185 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:55.849680 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:55.851323 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:55.852541 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b71db82d-57c1-418b-9623-94d487429fa8 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.263034 Jul 25 16:34:55.853323 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 404/841] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:55 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:56.880187 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:56.881022 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:56.888804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:56.889366 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:56.890391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:56.890860 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:57.062021 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:57.077440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:57.080816 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:57.083429 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f28449b2-f27c-4864-9558-d9bfcb27b33e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.207587 Jul 25 16:34:57.084492 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 438/842] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:56 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:34:58.127163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:58.128179 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:58.136336 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:58.136950 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:58.138184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:58.138760 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:58.358828 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:58.372677 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:58.374833 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:58.376243 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-c8e47ed4-b8e8-4489-a01a-34b52adf8f85 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.253319 Jul 25 16:34:58.376906 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 405/843] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:58 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:34:59.411741 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:34:59.412846 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:34:59.426047 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.426484 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.428425 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:34:59.429211 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:34:59.632528 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:59.647430 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:59.649531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:34:59.652577 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-728fda20-d119-4e57-811a-821cc3bafb06 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.246960 Jul 25 16:34:59.664692 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 439/844] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:34:59 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:00.688648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:00.689374 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:00.696613 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:00.697102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:00.698207 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:00.698686 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:00.880318 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:00.889975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:00.891795 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:00.893123 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9ca0d65f-0f60-475c-8dbc-092c37166bc7 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.210775 Jul 25 16:35:00.899286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 406/845] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:00 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:01.931522 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:01.932237 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:01.939350 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:01.939844 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:01.940747 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:01.941209 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:02.119040 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:02.128064 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:02.129889 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:02.130895 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7e2d3330-c6d2-4a30-ab00-0682bccaef62 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.203633 Jul 25 16:35:02.131469 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 440/846] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:01 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:03.156702 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:03.157668 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:03.165678 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:03.166287 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:03.167396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:03.167855 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:03.321922 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:03.330675 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:03.332221 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:03.333597 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5a243ce0-ee73-48c4-8c20-47fa08f7430b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.182155 Jul 25 16:35:03.334205 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 407/847] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:03 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:04.357579 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:04.358434 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:04.366000 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:04.366586 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:04.367484 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:04.368037 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:04.538692 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:04.549626 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:04.551207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:04.552434 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-61cc89a7-c59f-4ca7-a454-d13d07aa1a3b tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.199049 Jul 25 16:35:04.553012 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 441/848] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:04 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:04.909554 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-883d1fdf-f5d6-419e-b445-885190ceed54 req-4c17697b-2838-4513-a515-4ec16e2354f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6", "name": "network-vif-plugged", "status": "completed", "tag": "567c5e1f-440f-4238-a0c4-7abbd6b3c53f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:04.922960 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-883d1fdf-f5d6-419e-b445-885190ceed54 req-4c17697b-2838-4513-a515-4ec16e2354f6 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:04.924917 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-883d1fdf-f5d6-419e-b445-885190ceed54 req-4c17697b-2838-4513-a515-4ec16e2354f6 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:04.952377 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-883d1fdf-f5d6-419e-b445-885190ceed54 req-4c17697b-2838-4513-a515-4ec16e2354f6 service nova] Creating event network-vif-plugged:567c5e1f-440f-4238-a0c4-7abbd6b3c53f for instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 on hv-cinder-83697 Jul 25 16:35:04.961635 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-883d1fdf-f5d6-419e-b445-885190ceed54 req-4c17697b-2838-4513-a515-4ec16e2354f6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055965 Jul 25 16:35:04.962810 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 408/849] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:05.576159 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:05.576810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:05.587975 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:05.588413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:05.589314 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:05.589806 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:05.766572 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:05.775867 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:05.777379 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:05.778593 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f1fce4e7-88a5-44fc-9cb2-c7102b404ca5 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.206618 Jul 25 16:35:05.779160 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 442/850] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:05 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:06.807053 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:06.807673 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:06.817076 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:06.817592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:06.818678 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:06.819367 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:06.988476 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:06.999658 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:07.001295 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:07.002851 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a636bd77-a20e-41f3-8ce6-abe185246848 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1730 microversion: 2.20 time: 0.203289 Jul 25 16:35:07.003436 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 409/851] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:06 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:08.027849 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:08.028765 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:08.037500 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:08.038149 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:08.039261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:08.039914 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:08.218713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:08.228032 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:08.229689 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:08.230999 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-007d7837-9f22-44a1-bd9e-0cf1c189ed93 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1717 microversion: 2.20 time: 0.207969 Jul 25 16:35:08.231602 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 443/852] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:08 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1717 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 16:35:37.202825 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1267890205", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241383450", "security_groups": [{"name": "tempest-secgroup-smoke-487919838"}], "block_device_mapping_v2": [{"uuid": "fb0de03c-4576-4fa0-9c2c-1adb59b5aabd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5179c8ca-857c-4cbe-a31d-a95e81512509"}]}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:37.213855 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=25 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:37.214813 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:37.352901 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] validate_networks() for [('5179c8ca-857c-4cbe-a31d-a95e81512509', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:35:37.872574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:35:37.873034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:35:37.873678 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:35:37.874227 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:35:37.874751 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:35:37.885641 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:37.886120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:37.887439 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:37.888182 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:37.926319 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Getting quotas for project ee2c762eec4646afbd0ea4d71a58894d. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:35:37.934571 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Getting quotas for user d3eebc82ce654013998f58585c123a0e and project ee2c762eec4646afbd0ea4d71a58894d. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:35:38.020103 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:35:38.022255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb0de03c-4576-4fa0-9c2c-1adb59b5aabd',volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:35:38.195071 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b6ab47d4-7a20-4204-9137-52ceb789e749 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.996170 Jul 25 16:35:38.196280 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 410/853] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:35:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:35:38.208992 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8898cf4c-c538-4db0-ac0e-fb41e249fc14 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:38.210172 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8898cf4c-c538-4db0-ac0e-fb41e249fc14 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:38.212789 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=23 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:38.213819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:38.302791 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8898cf4c-c538-4db0-ac0e-fb41e249fc14 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:38.311934 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8898cf4c-c538-4db0-ac0e-fb41e249fc14 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1094 microversion: 2.1 time: 0.107280 Jul 25 16:35:38.312577 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 444/854] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:38 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1094 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:39.340742 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f73eacea-207c-4c07-8e2a-fefe5d264c84 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:39.342043 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f73eacea-207c-4c07-8e2a-fefe5d264c84 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:39.441622 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-f73eacea-207c-4c07-8e2a-fefe5d264c84 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:39.450555 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f73eacea-207c-4c07-8e2a-fefe5d264c84 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1094 microversion: 2.1 time: 0.119407 Jul 25 16:35:39.451244 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 411/855] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:39 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:39.602892 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f04bbcba-326a-4c17-b7c3-81abc80887eb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:39.605660 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f04bbcba-326a-4c17-b7c3-81abc80887eb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:39.614367 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f04bbcba-326a-4c17-b7c3-81abc80887eb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:39.614906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f04bbcba-326a-4c17-b7c3-81abc80887eb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:39.615791 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f04bbcba-326a-4c17-b7c3-81abc80887eb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:39.616262 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f04bbcba-326a-4c17-b7c3-81abc80887eb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:39.651849 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f04bbcba-326a-4c17-b7c3-81abc80887eb tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053155 Jul 25 16:35:39.652545 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 445/856] 10.222.0.66 () {60 vars in 1343 bytes} [Mon Jul 25 16:35:39 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:39.757274 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f12acd21-7875-46ab-a2b8-edef4d428f6e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:39.758133 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f12acd21-7875-46ab-a2b8-edef4d428f6e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:39.769610 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12acd21-7875-46ab-a2b8-edef4d428f6e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:39.770377 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12acd21-7875-46ab-a2b8-edef4d428f6e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:39.771815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12acd21-7875-46ab-a2b8-edef4d428f6e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:39.772570 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f12acd21-7875-46ab-a2b8-edef4d428f6e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:39.807735 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f12acd21-7875-46ab-a2b8-edef4d428f6e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:35:39.902611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f12acd21-7875-46ab-a2b8-edef4d428f6e tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 204 len: 0 microversion: 2.20 time: 0.152205 Jul 25 16:35:39.903232 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 412/857] 10.222.0.66 () {60 vars in 1280 bytes} [Mon Jul 25 16:35:39 2022] DELETE /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:35:39.914540 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:39.915225 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:39.922749 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:39.923530 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:39.924328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:39.924783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:40.112728 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:40.122575 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:40.124127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:40.125380 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0d164bc4-1457-489b-87f5-830980a48120 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.216412 Jul 25 16:35:40.125958 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 446/858] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:39 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:40.489423 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb6525c2-1496-4610-b216-ced888f932b6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:40.490732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb6525c2-1496-4610-b216-ced888f932b6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:40.579757 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb6525c2-1496-4610-b216-ced888f932b6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:40.589296 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb6525c2-1496-4610-b216-ced888f932b6 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1094 microversion: 2.1 time: 0.108108 Jul 25 16:35:40.590051 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 413/859] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:40 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:41.155422 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:41.156407 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:41.164798 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:41.165548 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:41.166470 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:41.167057 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:41.394978 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:41.406018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:41.407734 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:41.408998 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-f62b8873-d267-42af-af23-bd5325f12640 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1723 microversion: 2.20 time: 0.257792 Jul 25 16:35:41.410073 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 447/860] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:41 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:41.625723 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2b25cdc3-8489-470b-832e-53e1a603e92a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:41.627004 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-2b25cdc3-8489-470b-832e-53e1a603e92a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:41.723054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-2b25cdc3-8489-470b-832e-53e1a603e92a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:41.740257 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2b25cdc3-8489-470b-832e-53e1a603e92a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1094 microversion: 2.1 time: 0.121303 Jul 25 16:35:41.741404 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 414/861] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:41 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1094 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:42.451504 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:42.452947 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:42.460906 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:42.461735 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:42.462907 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:42.463779 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:42.547663 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:42.565220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:42.567868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37e7fecdaae94842b6917152fb7f1598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4501489e56744cf98e49895b6d5aa6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:42.570229 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-2231258f-4347-4a9e-aedb-a4b46437af6d tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 200 len: 1655 microversion: 2.20 time: 0.123424 Jul 25 16:35:42.572955 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 448/862] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:42 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 1655 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 16:35:42.787300 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-87020279-a999-4000-8d1a-7eff77d89481 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:42.795985 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-87020279-a999-4000-8d1a-7eff77d89481 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:42.812826 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87020279-a999-4000-8d1a-7eff77d89481 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:42.814045 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87020279-a999-4000-8d1a-7eff77d89481 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:42.815793 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87020279-a999-4000-8d1a-7eff77d89481 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:42.817243 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-87020279-a999-4000-8d1a-7eff77d89481 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:42.933952 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-456343b8-48ce-461a-be88-e71d76e84f2f req-845f0b7b-ac51-41a9-842d-662d121c2cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6", "name": "network-vif-deleted", "tag": "567c5e1f-440f-4238-a0c4-7abbd6b3c53f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:42.953410 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-456343b8-48ce-461a-be88-e71d76e84f2f req-845f0b7b-ac51-41a9-842d-662d121c2cc2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:42.954545 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-456343b8-48ce-461a-be88-e71d76e84f2f req-845f0b7b-ac51-41a9-842d-662d121c2cc2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:42.981920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-456343b8-48ce-461a-be88-e71d76e84f2f req-845f0b7b-ac51-41a9-842d-662d121c2cc2 service nova] Creating event network-vif-deleted:567c5e1f-440f-4238-a0c4-7abbd6b3c53f for instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 on hv-cinder-83697 Jul 25 16:35:42.991596 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-87020279-a999-4000-8d1a-7eff77d89481 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:42.991979 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-456343b8-48ce-461a-be88-e71d76e84f2f req-845f0b7b-ac51-41a9-842d-662d121c2cc2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288877 Jul 25 16:35:42.993502 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 415/863] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:43.015404 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-87020279-a999-4000-8d1a-7eff77d89481 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1144 microversion: 2.1 time: 0.242223 Jul 25 16:35:43.026705 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 449/864] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:42 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1144 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:43.618453 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:43.620188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:43.632962 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:43.633842 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:43.635450 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:43.636634 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:43.664196 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] HTTP exception thrown: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Request method failure captured: Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 HTTP/1.1 Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sUoEWPqHoRbE4lTH8jJ-p_aTOc1Tv7QdX30xBOqxl2wfr3fMfaNKab8iAXjJR44Zh32k2_DZYH9uQsdVGJy0UjMDeZEhmT9MkcTvIGaV8_kGc1WTt9usx6TjxrkNP9lg2KH66fobtvF0EbKA5G9jhAYN2tY1WMIFGpMKwa2iaZBG50 Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:35:43.667707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4501489e56744cf98e49895b6d5aa6f8"}]}] Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 37e7fecdaae94842b6917152fb7f1598 Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:43.670970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'd37d1a5d-eb30-4654-a38f-d9e9b4dec6b6'} Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:43.672708 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:43.677161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:43.683253 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Returning 404 to user: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:43.683253 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-49ea7535-7986-4e58-a291-cb16ab3b2f57 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 404 len: 111 microversion: 2.20 time: 0.060221 Jul 25 16:35:43.683253 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 416/865] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:43 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:35:43.693841 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7b259e1a-68f5-4552-9117-3e3ec0dfd868 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '.version_select at 0x7f440a5d19d0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:43.730923 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7b259e1a-68f5-4552-9117-3e3ec0dfd868 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-250084202" status: 204 len: 0 microversion: 2.20 time: 0.047685 Jul 25 16:35:43.732144 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 450/866] 10.222.0.66 () {60 vars in 1259 bytes} [Mon Jul 25 16:35:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-250084202 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 16:35:44.055422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-34e43c83-2dcf-47db-ae67-5df1e58484df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:44.056152 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-34e43c83-2dcf-47db-ae67-5df1e58484df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:44.076620 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34e43c83-2dcf-47db-ae67-5df1e58484df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:44.077427 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34e43c83-2dcf-47db-ae67-5df1e58484df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:44.078383 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34e43c83-2dcf-47db-ae67-5df1e58484df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:44.078820 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-34e43c83-2dcf-47db-ae67-5df1e58484df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:44.203186 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-34e43c83-2dcf-47db-ae67-5df1e58484df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:44.218161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-34e43c83-2dcf-47db-ae67-5df1e58484df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1210 microversion: 2.1 time: 0.166771 Jul 25 16:35:44.219086 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 417/867] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:44 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1210 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:45.258744 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-38e000b6-7979-42b9-86e3-2675d3c66fa7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:45.260339 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-38e000b6-7979-42b9-86e3-2675d3c66fa7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:45.274475 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38e000b6-7979-42b9-86e3-2675d3c66fa7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:45.275489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38e000b6-7979-42b9-86e3-2675d3c66fa7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:45.276657 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38e000b6-7979-42b9-86e3-2675d3c66fa7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:45.277217 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-38e000b6-7979-42b9-86e3-2675d3c66fa7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:45.547891 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-38e000b6-7979-42b9-86e3-2675d3c66fa7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:45.561252 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-38e000b6-7979-42b9-86e3-2675d3c66fa7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.309522 Jul 25 16:35:45.568406 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 451/868] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:45 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:46.251108 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-afe15e34-e462-48a5-b4eb-7a3e3b768baf req-01c3086f-71de-491a-9111-8b1bac87f157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54d3f0f-e102-438c-aac9-c9f4ddc62bf0", "tag": "4b1fbfc5-127d-402f-9670-ae5c5bf444c1"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:46.267414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-afe15e34-e462-48a5-b4eb-7a3e3b768baf req-01c3086f-71de-491a-9111-8b1bac87f157 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:46.273668 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-afe15e34-e462-48a5-b4eb-7a3e3b768baf req-01c3086f-71de-491a-9111-8b1bac87f157 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:46.301757 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-afe15e34-e462-48a5-b4eb-7a3e3b768baf req-01c3086f-71de-491a-9111-8b1bac87f157 service nova] Creating event network-changed:4b1fbfc5-127d-402f-9670-ae5c5bf444c1 for instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 on hv-cinder-83697 Jul 25 16:35:46.308315 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-afe15e34-e462-48a5-b4eb-7a3e3b768baf req-01c3086f-71de-491a-9111-8b1bac87f157 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062984 Jul 25 16:35:46.309243 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 418/869] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:35:46.503838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:46.505617 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:46.514823 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:46.515257 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:46.516865 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:46.517933 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:46.542513 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] HTTP exception thrown: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Request method failure captured: Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 HTTP/1.1 Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sUoEWPqHoRbE4lTH8jJ-p_aTOc1Tv7QdX30xBOqxl2wfr3fMfaNKab8iAXjJR44Zh32k2_DZYH9uQsdVGJy0UjMDeZEhmT9MkcTvIGaV8_kGc1WTt9usx6TjxrkNP9lg2KH66fobtvF0EbKA5G9jhAYN2tY1WMIFGpMKwa2iaZBG50 Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:35:46.545565 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4501489e56744cf98e49895b6d5aa6f8"}]}] Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 37e7fecdaae94842b6917152fb7f1598 Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.547421 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'd37d1a5d-eb30-4654-a38f-d9e9b4dec6b6'} Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:46.548267 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.551486 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.553678 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Returning 404 to user: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:46.553678 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-428dc77d-28e8-4bf1-8a18-218424081391 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 404 len: 111 microversion: 2.20 time: 0.049321 Jul 25 16:35:46.553678 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 452/870] 10.222.0.66 () {60 vars in 1280 bytes} [Mon Jul 25 16:35:46 2022] DELETE /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:35:46.560116 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:46.561074 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:46.567992 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:46.568427 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:46.569523 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:46.569970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:46.594102 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] HTTP exception thrown: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Request method failure captured: Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 HTTP/1.1 Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sUoEWPqHoRbE4lTH8jJ-p_aTOc1Tv7QdX30xBOqxl2wfr3fMfaNKab8iAXjJR44Zh32k2_DZYH9uQsdVGJy0UjMDeZEhmT9MkcTvIGaV8_kGc1WTt9usx6TjxrkNP9lg2KH66fobtvF0EbKA5G9jhAYN2tY1WMIFGpMKwa2iaZBG50 Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:35:46.597283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4501489e56744cf98e49895b6d5aa6f8"}]}] Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 37e7fecdaae94842b6917152fb7f1598 Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.600161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'd37d1a5d-eb30-4654-a38f-d9e9b4dec6b6'} Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:46.601621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. Jul 25 16:35:46.605302 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:46.607575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Returning 404 to user: Instance d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:46.607575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d4521c00-6e33-49c2-9402-080d91bc6965 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6" status: 404 len: 111 microversion: 2.20 time: 0.044960 Jul 25 16:35:46.607575 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 419/871] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:46 2022] GET /compute/v2.1/servers/d37d1a5d-eb30-4654-a38f-d9e9b4dec6b6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:35:46.617523 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8a915ae7-13b8-4490-82bc-fe779e86ade9 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:46.618806 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8a915ae7-13b8-4490-82bc-fe779e86ade9 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:46.631342 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a915ae7-13b8-4490-82bc-fe779e86ade9 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:46.632143 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a915ae7-13b8-4490-82bc-fe779e86ade9 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:46.633657 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a915ae7-13b8-4490-82bc-fe779e86ade9 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:46.634517 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a915ae7-13b8-4490-82bc-fe779e86ade9 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:46.858619 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8a915ae7-13b8-4490-82bc-fe779e86ade9 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:46.867713 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8a915ae7-13b8-4490-82bc-fe779e86ade9 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.266942 Jul 25 16:35:46.868337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 453/872] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:46 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:47.828046 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:47.828909 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:47.841311 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:47.841820 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:47.842699 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:47.843132 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:47.863040 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] HTTP exception thrown: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Request method failure captured: Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e HTTP/1.1 Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sUoEWPqHoRbE4lTH8jJ-p_aTOc1Tv7QdX30xBOqxl2wfr3fMfaNKab8iAXjJR44Zh32k2_DZYH9uQsdVGJy0UjMDeZEhmT9MkcTvIGaV8_kGc1WTt9usx6TjxrkNP9lg2KH66fobtvF0EbKA5G9jhAYN2tY1WMIFGpMKwa2iaZBG50 Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:35:47.864836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4501489e56744cf98e49895b6d5aa6f8"}]}] Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 37e7fecdaae94842b6917152fb7f1598 Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.867838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '9f714dd8-86f9-4043-8bb6-39286efcfc1e'} Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:47.869601 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.872551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.875306 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Returning 404 to user: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:47.875306 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23bc934f-a3b3-4c7c-ae29-d1e32dd8b0d2 tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 404 len: 111 microversion: 2.20 time: 0.054219 Jul 25 16:35:47.875306 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 420/873] 10.222.0.66 () {60 vars in 1280 bytes} [Mon Jul 25 16:35:47 2022] DELETE /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:35:47.876810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:47.877609 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] [instance: 9f714dd8-86f9-4043-8bb6-39286efcfc1e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:47.885445 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:47.886105 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:47.887209 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:47.887817 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:47.894655 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-05358089-291e-47b5-8544-d517c4f5f58e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:47.895790 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-05358089-291e-47b5-8544-d517c4f5f58e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:47.903414 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:47.905756 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05358089-291e-47b5-8544-d517c4f5f58e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:47.906064 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] HTTP exception thrown: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.906259 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05358089-291e-47b5-8544-d517c4f5f58e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:47.907471 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05358089-291e-47b5-8544-d517c4f5f58e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Request method failure captured: Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e HTTP/1.1 Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sUoEWPqHoRbE4lTH8jJ-p_aTOc1Tv7QdX30xBOqxl2wfr3fMfaNKab8iAXjJR44Zh32k2_DZYH9uQsdVGJy0UjMDeZEhmT9MkcTvIGaV8_kGc1WTt9usx6TjxrkNP9lg2KH66fobtvF0EbKA5G9jhAYN2tY1WMIFGpMKwa2iaZBG50 Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:35:47.908060 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4501489e56744cf98e49895b6d5aa6f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4501489e56744cf98e49895b6d5aa6f8"}]}] Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 4501489e56744cf98e49895b6d5aa6f8 Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-678495376 Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 37e7fecdaae94842b6917152fb7f1598 Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeShelveTestJSON-678495376-project Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.911287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '9f714dd8-86f9-4043-8bb6-39286efcfc1e'} Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:35:47.912919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. Jul 25 16:35:47.916013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:35:47.919846 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-05358089-291e-47b5-8544-d517c4f5f58e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:47.920018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] Returning 404 to user: Instance 9f714dd8-86f9-4043-8bb6-39286efcfc1e could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:35:47.920018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0b358062-00a2-4bc8-bca7-0208043e573f tempest-AttachVolumeShelveTestJSON-678495376 tempest-AttachVolumeShelveTestJSON-678495376-project] 10.222.0.66 "GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e" status: 404 len: 111 microversion: 2.20 time: 0.037564 Jul 25 16:35:47.920018 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 454/874] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Jul 25 16:35:47 2022] GET /compute/v2.1/servers/9f714dd8-86f9-4043-8bb6-39286efcfc1e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:35:48.191680 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-05358089-291e-47b5-8544-d517c4f5f58e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:48.202420 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-05358089-291e-47b5-8544-d517c4f5f58e tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.314822 Jul 25 16:35:48.203019 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 421/875] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:47 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:49.241771 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8e8cc2ad-f390-4569-bd16-e26285b969df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:49.243089 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8e8cc2ad-f390-4569-bd16-e26285b969df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:49.246702 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:49.258015 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e8cc2ad-f390-4569-bd16-e26285b969df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:49.258841 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e8cc2ad-f390-4569-bd16-e26285b969df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:49.260367 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e8cc2ad-f390-4569-bd16-e26285b969df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:49.261134 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8e8cc2ad-f390-4569-bd16-e26285b969df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:49.588291 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8e8cc2ad-f390-4569-bd16-e26285b969df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:49.598779 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8e8cc2ad-f390-4569-bd16-e26285b969df tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.365051 Jul 25 16:35:49.599592 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 455/876] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:49 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:50.626688 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ea0dfc92-280e-400e-9af1-58e07f2c52b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:50.628150 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ea0dfc92-280e-400e-9af1-58e07f2c52b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:50.637595 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea0dfc92-280e-400e-9af1-58e07f2c52b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:50.638179 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea0dfc92-280e-400e-9af1-58e07f2c52b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:50.639072 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea0dfc92-280e-400e-9af1-58e07f2c52b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:50.639770 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ea0dfc92-280e-400e-9af1-58e07f2c52b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:50.831974 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ea0dfc92-280e-400e-9af1-58e07f2c52b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:50.841236 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ea0dfc92-280e-400e-9af1-58e07f2c52b0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.219912 Jul 25 16:35:50.848701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 422/877] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:50 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:51.864931 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0b8d7d16-7251-4734-83ab-989e6973352a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:51.866768 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0b8d7d16-7251-4734-83ab-989e6973352a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:51.877776 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b8d7d16-7251-4734-83ab-989e6973352a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:51.878380 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b8d7d16-7251-4734-83ab-989e6973352a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:51.879462 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b8d7d16-7251-4734-83ab-989e6973352a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:51.880119 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b8d7d16-7251-4734-83ab-989e6973352a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:52.096357 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0b8d7d16-7251-4734-83ab-989e6973352a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:52.113478 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0b8d7d16-7251-4734-83ab-989e6973352a tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.253362 Jul 25 16:35:52.115531 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 456/878] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:51 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:53.155005 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=12 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:35:53.432120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-dc69bb56-cbdb-41b9-95fa-c49d1a6f3ac2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:53.433161 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-dc69bb56-cbdb-41b9-95fa-c49d1a6f3ac2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:53.447392 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc69bb56-cbdb-41b9-95fa-c49d1a6f3ac2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:53.447831 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc69bb56-cbdb-41b9-95fa-c49d1a6f3ac2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:53.448626 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc69bb56-cbdb-41b9-95fa-c49d1a6f3ac2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:53.449063 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-dc69bb56-cbdb-41b9-95fa-c49d1a6f3ac2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:53.678975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-dc69bb56-cbdb-41b9-95fa-c49d1a6f3ac2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:53.691346 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-dc69bb56-cbdb-41b9-95fa-c49d1a6f3ac2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.545866 Jul 25 16:35:53.692512 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 423/879] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:53 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:54.724704 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-66c40bd6-a248-4363-b5b8-e3e99eab38e2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:54.725685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-66c40bd6-a248-4363-b5b8-e3e99eab38e2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:54.739440 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66c40bd6-a248-4363-b5b8-e3e99eab38e2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:54.740343 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66c40bd6-a248-4363-b5b8-e3e99eab38e2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:54.741948 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66c40bd6-a248-4363-b5b8-e3e99eab38e2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:54.743538 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-66c40bd6-a248-4363-b5b8-e3e99eab38e2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:55.014750 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-66c40bd6-a248-4363-b5b8-e3e99eab38e2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:55.026853 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-66c40bd6-a248-4363-b5b8-e3e99eab38e2 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.306397 Jul 25 16:35:55.027823 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 457/880] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:54 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:56.056517 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-0cd54596-d1c8-435b-bea5-b03e9ea71304 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:56.060715 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-0cd54596-d1c8-435b-bea5-b03e9ea71304 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:56.074332 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd54596-d1c8-435b-bea5-b03e9ea71304 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:56.075120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd54596-d1c8-435b-bea5-b03e9ea71304 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:56.076565 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd54596-d1c8-435b-bea5-b03e9ea71304 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:56.077715 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-0cd54596-d1c8-435b-bea5-b03e9ea71304 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:56.296489 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-0cd54596-d1c8-435b-bea5-b03e9ea71304 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:56.307511 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-0cd54596-d1c8-435b-bea5-b03e9ea71304 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.260660 Jul 25 16:35:56.309054 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 424/881] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:56 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:35:57.345272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5174ea03-4aea-4fda-918e-5664e8d4929f tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:57.346313 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5174ea03-4aea-4fda-918e-5664e8d4929f tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:57.359586 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5174ea03-4aea-4fda-918e-5664e8d4929f tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:57.360651 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5174ea03-4aea-4fda-918e-5664e8d4929f tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:57.362078 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5174ea03-4aea-4fda-918e-5664e8d4929f tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:57.362790 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5174ea03-4aea-4fda-918e-5664e8d4929f tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:57.396077 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-8052e9a8-4e15-43af-8c3f-525062a75c3f req-0c6e14aa-88cc-4ba4-bc8f-81846f2d02d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54d3f0f-e102-438c-aac9-c9f4ddc62bf0", "name": "network-vif-plugged", "status": "completed", "tag": "4b1fbfc5-127d-402f-9670-ae5c5bf444c1"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:35:57.409328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8052e9a8-4e15-43af-8c3f-525062a75c3f req-0c6e14aa-88cc-4ba4-bc8f-81846f2d02d1 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:57.410219 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8052e9a8-4e15-43af-8c3f-525062a75c3f req-0c6e14aa-88cc-4ba4-bc8f-81846f2d02d1 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:57.425915 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-8052e9a8-4e15-43af-8c3f-525062a75c3f req-0c6e14aa-88cc-4ba4-bc8f-81846f2d02d1 service nova] Creating event network-vif-plugged:4b1fbfc5-127d-402f-9670-ae5c5bf444c1 for instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 on hv-cinder-83697 Jul 25 16:35:57.433764 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-8052e9a8-4e15-43af-8c3f-525062a75c3f req-0c6e14aa-88cc-4ba4-bc8f-81846f2d02d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276034 Jul 25 16:35:57.434717 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 458/882] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:35:57.676444 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-5174ea03-4aea-4fda-918e-5664e8d4929f tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:57.693400 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5174ea03-4aea-4fda-918e-5664e8d4929f tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.354668 Jul 25 16:35:57.694532 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 425/883] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:57 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:35:58.734269 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8a9a74de-2a1c-4578-b6e5-863af40691d8 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:35:58.735795 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8a9a74de-2a1c-4578-b6e5-863af40691d8 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:35:58.751265 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a9a74de-2a1c-4578-b6e5-863af40691d8 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:58.751843 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a9a74de-2a1c-4578-b6e5-863af40691d8 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:58.752775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a9a74de-2a1c-4578-b6e5-863af40691d8 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:35:58.753305 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8a9a74de-2a1c-4578-b6e5-863af40691d8 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:35:59.025271 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8a9a74de-2a1c-4578-b6e5-863af40691d8 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:35:59.040144 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8a9a74de-2a1c-4578-b6e5-863af40691d8 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1265 microversion: 2.1 time: 0.314293 Jul 25 16:35:59.056717 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 459/884] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:35:58 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1265 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:00.073884 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b32d8b7f-c4b2-440e-b23a-bdad57eedb08 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:00.077318 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b32d8b7f-c4b2-440e-b23a-bdad57eedb08 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:00.087378 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b32d8b7f-c4b2-440e-b23a-bdad57eedb08 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:00.088050 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b32d8b7f-c4b2-440e-b23a-bdad57eedb08 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:00.089082 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b32d8b7f-c4b2-440e-b23a-bdad57eedb08 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:00.089852 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b32d8b7f-c4b2-440e-b23a-bdad57eedb08 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:00.540744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-b32d8b7f-c4b2-440e-b23a-bdad57eedb08 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:00.550133 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b32d8b7f-c4b2-440e-b23a-bdad57eedb08 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1452 microversion: 2.1 time: 0.484755 Jul 25 16:36:00.550852 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 426/885] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:00 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1452 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:00.593219 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-749898f8-1e97-4bcb-bb3c-89c8164ecd60 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:00.605419 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-749898f8-1e97-4bcb-bb3c-89c8164ecd60 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:00.633976 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-749898f8-1e97-4bcb-bb3c-89c8164ecd60 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:00.637140 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-749898f8-1e97-4bcb-bb3c-89c8164ecd60 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:00.639028 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-749898f8-1e97-4bcb-bb3c-89c8164ecd60 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:00.639969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-749898f8-1e97-4bcb-bb3c-89c8164ecd60 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:00.763634 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-46f9a3b0-4924-40b7-8366-49dfbbad0f1e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: .version_select at 0x7f440ae09dc0>, body: {"keypair": {"name": "tempest-keypair-1034980774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjITWGcKmbPVYpz47L2YNRJo9wicQgqiIdow2MdxtRq8gbTO9fHe3a1zq5nNjESIjd7RataFrhqLF18KIU+3GvEmBISCwhYmLftUVGUQJ4WUTE8Y1S6OwY9WWJaFHWYDw=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:00.795898 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-46f9a3b0-4924-40b7-8366-49dfbbad0f1e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for project 7ad628e26f9349e59d73f6606242d957. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:36:00.803089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-46f9a3b0-4924-40b7-8366-49dfbbad0f1e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for user 1f86305f296440bcae5268e1a0c8b089 and project 7ad628e26f9349e59d73f6606242d957. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:36:00.845953 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-46f9a3b0-4924-40b7-8366-49dfbbad0f1e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158600 Jul 25 16:36:00.849417 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 427/886] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:36:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:36:00.897479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-749898f8-1e97-4bcb-bb3c-89c8164ecd60 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:00.907375 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-749898f8-1e97-4bcb-bb3c-89c8164ecd60 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1452 microversion: 2.1 time: 0.324024 Jul 25 16:36:00.908114 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 460/887] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:00 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1452 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:03.118183 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-278631436", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efa07ab3-0bdf-47e0-83af-e1fbc262fab3"}], "security_groups": [{"name": "tempest-securitygroup--91506371"}], "key_name": "tempest-keypair-1034980774", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:03.349928 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] validate_networks() for [('efa07ab3-0bdf-47e0-83af-e1fbc262fab3', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:36:04.183112 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:36:04.185165 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:36:04.186087 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:36:04.186970 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:36:04.188043 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:36:04.204855 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:04.206108 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:04.208128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:04.209156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:04.240870 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-87a63300-3ecd-4ab9-b0e1-8d1e2723bc69 req-ea83872c-6df0-4f57-be3f-f7d76de7dfc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54d3f0f-e102-438c-aac9-c9f4ddc62bf0", "tag": "4b1fbfc5-127d-402f-9670-ae5c5bf444c1"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:04.246821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for project 7ad628e26f9349e59d73f6606242d957. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:36:04.255498 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for user 1f86305f296440bcae5268e1a0c8b089 and project 7ad628e26f9349e59d73f6606242d957. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:36:04.255848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-87a63300-3ecd-4ab9-b0e1-8d1e2723bc69 req-ea83872c-6df0-4f57-be3f-f7d76de7dfc9 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:04.256631 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-87a63300-3ecd-4ab9-b0e1-8d1e2723bc69 req-ea83872c-6df0-4f57-be3f-f7d76de7dfc9 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:04.276818 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-87a63300-3ecd-4ab9-b0e1-8d1e2723bc69 req-ea83872c-6df0-4f57-be3f-f7d76de7dfc9 service nova] Creating event network-changed:4b1fbfc5-127d-402f-9670-ae5c5bf444c1 for instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 on hv-cinder-83697 Jul 25 16:36:04.280997 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:36:04.283786 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-87a63300-3ecd-4ab9-b0e1-8d1e2723bc69 req-ea83872c-6df0-4f57-be3f-f7d76de7dfc9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158145 Jul 25 16:36:04.284920 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 461/888] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:36:04.286909 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:36:04.382539 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-b8e410bc-f332-4b16-bbf3-a19ab8564ef2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.273587 Jul 25 16:36:04.394125 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 428/889] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:36:03 2022] POST /compute/v2.1/servers => generated 400 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:36:04.402344 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-aefd91e7-5811-4d17-9912-2be84741c95b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:04.403306 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-aefd91e7-5811-4d17-9912-2be84741c95b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:04.551608 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-aefd91e7-5811-4d17-9912-2be84741c95b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:04.565231 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-aefd91e7-5811-4d17-9912-2be84741c95b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1241 microversion: 2.1 time: 0.167674 Jul 25 16:36:04.566888 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 462/890] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:04 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1241 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:05.605403 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-53bc67cb-f811-4f40-8978-c9683ff1158b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:05.606435 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-53bc67cb-f811-4f40-8978-c9683ff1158b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:05.618860 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53bc67cb-f811-4f40-8978-c9683ff1158b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:05.619630 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53bc67cb-f811-4f40-8978-c9683ff1158b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:05.621316 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53bc67cb-f811-4f40-8978-c9683ff1158b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:05.622386 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-53bc67cb-f811-4f40-8978-c9683ff1158b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:05.786248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-53bc67cb-f811-4f40-8978-c9683ff1158b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:05.810586 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-53bc67cb-f811-4f40-8978-c9683ff1158b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1237 microversion: 2.1 time: 0.211644 Jul 25 16:36:05.811878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 429/891] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:05 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1237 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:06.835476 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7831f24c-7e1e-46bd-9475-dbb8f21dc076 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:06.836425 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7831f24c-7e1e-46bd-9475-dbb8f21dc076 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:06.847299 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7831f24c-7e1e-46bd-9475-dbb8f21dc076 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:06.847848 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7831f24c-7e1e-46bd-9475-dbb8f21dc076 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:06.848831 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7831f24c-7e1e-46bd-9475-dbb8f21dc076 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:06.849420 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7831f24c-7e1e-46bd-9475-dbb8f21dc076 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:06.944806 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7831f24c-7e1e-46bd-9475-dbb8f21dc076 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:06.953894 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7831f24c-7e1e-46bd-9475-dbb8f21dc076 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1299 microversion: 2.1 time: 0.123612 Jul 25 16:36:06.954928 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 463/892] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:06 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:07.977295 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a9c76ee2-7bd3-403f-aea0-7cbb5824df4d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:07.978956 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a9c76ee2-7bd3-403f-aea0-7cbb5824df4d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:07.982559 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:07.999920 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c76ee2-7bd3-403f-aea0-7cbb5824df4d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:08.000415 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c76ee2-7bd3-403f-aea0-7cbb5824df4d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:08.001225 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c76ee2-7bd3-403f-aea0-7cbb5824df4d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:08.001725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a9c76ee2-7bd3-403f-aea0-7cbb5824df4d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:08.014476 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:08.190391 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-a9c76ee2-7bd3-403f-aea0-7cbb5824df4d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:08.201004 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a9c76ee2-7bd3-403f-aea0-7cbb5824df4d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1365 microversion: 2.1 time: 0.227867 Jul 25 16:36:08.201672 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 430/893] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:07 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:36:08.567981 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-590dc061-a327-4664-9596-8647495be13b req-4a475abc-950b-4c2d-b029-a10d0ca14ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05732003-19e7-4e32-83f9-a73b782ef373", "tag": "9ba4db95-9de2-4b0f-8120-7fce184d685e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:08.579923 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:08.582113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-590dc061-a327-4664-9596-8647495be13b req-4a475abc-950b-4c2d-b029-a10d0ca14ab3 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:08.585038 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-590dc061-a327-4664-9596-8647495be13b req-4a475abc-950b-4c2d-b029-a10d0ca14ab3 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:08.586391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=87 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:08.602882 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-590dc061-a327-4664-9596-8647495be13b req-4a475abc-950b-4c2d-b029-a10d0ca14ab3 service nova] Creating event network-changed:9ba4db95-9de2-4b0f-8120-7fce184d685e for instance 05732003-19e7-4e32-83f9-a73b782ef373 on hv-cinder-83697 Jul 25 16:36:08.608587 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-590dc061-a327-4664-9596-8647495be13b req-4a475abc-950b-4c2d-b029-a10d0ca14ab3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044414 Jul 25 16:36:08.610164 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 464/894] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:09.235246 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-7febd956-6591-47d8-91e9-1ab7bfcdd3bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:09.235890 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-7febd956-6591-47d8-91e9-1ab7bfcdd3bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:09.243764 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7febd956-6591-47d8-91e9-1ab7bfcdd3bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:09.244289 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7febd956-6591-47d8-91e9-1ab7bfcdd3bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:09.245211 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7febd956-6591-47d8-91e9-1ab7bfcdd3bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:09.245687 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-7febd956-6591-47d8-91e9-1ab7bfcdd3bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:09.392807 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-7febd956-6591-47d8-91e9-1ab7bfcdd3bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:09.401848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-7febd956-6591-47d8-91e9-1ab7bfcdd3bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1365 microversion: 2.1 time: 0.170848 Jul 25 16:36:09.402430 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 431/895] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:09 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:10.425616 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-64879a3f-f825-4eb6-88fe-ef07a6595064 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:10.426369 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-64879a3f-f825-4eb6-88fe-ef07a6595064 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:10.433979 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64879a3f-f825-4eb6-88fe-ef07a6595064 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:10.434645 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64879a3f-f825-4eb6-88fe-ef07a6595064 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:10.435557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64879a3f-f825-4eb6-88fe-ef07a6595064 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:10.436042 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-64879a3f-f825-4eb6-88fe-ef07a6595064 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:10.628331 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-64879a3f-f825-4eb6-88fe-ef07a6595064 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:10.637960 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-64879a3f-f825-4eb6-88fe-ef07a6595064 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1365 microversion: 2.1 time: 0.217507 Jul 25 16:36:10.638579 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 465/896] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:10 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:11.664046 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e2e188b2-28ba-4b2e-a2ff-de9a0943734e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:11.665276 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e2e188b2-28ba-4b2e-a2ff-de9a0943734e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:11.677375 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e188b2-28ba-4b2e-a2ff-de9a0943734e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:11.678144 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e188b2-28ba-4b2e-a2ff-de9a0943734e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:11.679533 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e188b2-28ba-4b2e-a2ff-de9a0943734e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:11.680352 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e2e188b2-28ba-4b2e-a2ff-de9a0943734e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:11.869289 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-e2e188b2-28ba-4b2e-a2ff-de9a0943734e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:11.877634 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e2e188b2-28ba-4b2e-a2ff-de9a0943734e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1365 microversion: 2.1 time: 0.220930 Jul 25 16:36:11.878453 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 432/897] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:11 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:12.900559 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4bf3c87e-792d-4480-8101-8fd48fe21862 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:12.901259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4bf3c87e-792d-4480-8101-8fd48fe21862 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:12.908855 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bf3c87e-792d-4480-8101-8fd48fe21862 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:12.909289 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bf3c87e-792d-4480-8101-8fd48fe21862 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:12.910145 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bf3c87e-792d-4480-8101-8fd48fe21862 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:12.910564 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4bf3c87e-792d-4480-8101-8fd48fe21862 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:13.113378 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-4bf3c87e-792d-4480-8101-8fd48fe21862 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:13.125315 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4bf3c87e-792d-4480-8101-8fd48fe21862 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1365 microversion: 2.1 time: 0.229414 Jul 25 16:36:13.125909 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 466/898] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:12 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:13.257156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-dc522030-3f4f-454c-8bfb-f46a7c5c389b req-ae97ba39-1efe-4dcf-ae62-28cb1dfc6b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05732003-19e7-4e32-83f9-a73b782ef373", "name": "network-vif-plugged", "status": "completed", "tag": "9ba4db95-9de2-4b0f-8120-7fce184d685e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:13.278053 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dc522030-3f4f-454c-8bfb-f46a7c5c389b req-ae97ba39-1efe-4dcf-ae62-28cb1dfc6b86 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:13.278817 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-dc522030-3f4f-454c-8bfb-f46a7c5c389b req-ae97ba39-1efe-4dcf-ae62-28cb1dfc6b86 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:13.305589 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-dc522030-3f4f-454c-8bfb-f46a7c5c389b req-ae97ba39-1efe-4dcf-ae62-28cb1dfc6b86 service nova] Creating event network-vif-plugged:9ba4db95-9de2-4b0f-8120-7fce184d685e for instance 05732003-19e7-4e32-83f9-a73b782ef373 on hv-cinder-83697 Jul 25 16:36:13.318309 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-dc522030-3f4f-454c-8bfb-f46a7c5c389b req-ae97ba39-1efe-4dcf-ae62-28cb1dfc6b86 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069493 Jul 25 16:36:13.319727 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 433/899] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:14.152879 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-566e9a2f-d61f-4903-9636-02e2b31a5859 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:14.153992 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-566e9a2f-d61f-4903-9636-02e2b31a5859 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:14.164762 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-566e9a2f-d61f-4903-9636-02e2b31a5859 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:14.165690 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-566e9a2f-d61f-4903-9636-02e2b31a5859 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:14.167103 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-566e9a2f-d61f-4903-9636-02e2b31a5859 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:14.167643 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-566e9a2f-d61f-4903-9636-02e2b31a5859 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:14.357110 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-566e9a2f-d61f-4903-9636-02e2b31a5859 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:14.366259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-566e9a2f-d61f-4903-9636-02e2b31a5859 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1365 microversion: 2.1 time: 0.221368 Jul 25 16:36:14.367070 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 467/900] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:14 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:15.386602 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:15.388252 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=10 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:15.394251 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-031467f5-6196-4d3e-8513-4cef55b020ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:15.395163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-031467f5-6196-4d3e-8513-4cef55b020ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:15.404446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-031467f5-6196-4d3e-8513-4cef55b020ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:15.404880 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-031467f5-6196-4d3e-8513-4cef55b020ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:15.405720 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-031467f5-6196-4d3e-8513-4cef55b020ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:15.406177 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-031467f5-6196-4d3e-8513-4cef55b020ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:15.585032 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-031467f5-6196-4d3e-8513-4cef55b020ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:36:15.594301 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-031467f5-6196-4d3e-8513-4cef55b020ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1554 microversion: 2.1 time: 0.208669 Jul 25 16:36:15.595120 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 434/901] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:36:15 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:36:15.623561 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-443b94be-0096-4426-a12c-da11772b1426 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:15.624415 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-443b94be-0096-4426-a12c-da11772b1426 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:15.627978 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:15.639010 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-443b94be-0096-4426-a12c-da11772b1426 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:15.639761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-443b94be-0096-4426-a12c-da11772b1426 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:15.641125 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-443b94be-0096-4426-a12c-da11772b1426 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:15.641893 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-443b94be-0096-4426-a12c-da11772b1426 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:15.769270 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-443b94be-0096-4426-a12c-da11772b1426 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153443 Jul 25 16:36:15.769982 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 468/902] 10.222.0.66 () {58 vars in 1275 bytes} [Mon Jul 25 16:36:15 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:36:16.963313 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-90003408-cb81-483e-a8cb-b1a9ec67d821 req-5eb711e5-3b1e-41bd-951f-f44fcc41d687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05732003-19e7-4e32-83f9-a73b782ef373", "tag": "9ba4db95-9de2-4b0f-8120-7fce184d685e"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:16.984295 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-90003408-cb81-483e-a8cb-b1a9ec67d821 req-5eb711e5-3b1e-41bd-951f-f44fcc41d687 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:16.985360 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-90003408-cb81-483e-a8cb-b1a9ec67d821 req-5eb711e5-3b1e-41bd-951f-f44fcc41d687 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:17.009386 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-90003408-cb81-483e-a8cb-b1a9ec67d821 req-5eb711e5-3b1e-41bd-951f-f44fcc41d687 service nova] Creating event network-changed:9ba4db95-9de2-4b0f-8120-7fce184d685e for instance 05732003-19e7-4e32-83f9-a73b782ef373 on hv-cinder-83697 Jul 25 16:36:17.018005 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-90003408-cb81-483e-a8cb-b1a9ec67d821 req-5eb711e5-3b1e-41bd-951f-f44fcc41d687 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061026 Jul 25 16:36:17.018756 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 435/903] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:44.323021 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:36:44.324031 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Mon Jul 25 16:36:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:36:52.488385 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=9 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:52.489911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=23 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:52.498113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-75ff0ca8-696a-4fef-888a-fbbeaf04661b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:36:52.499012 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-75ff0ca8-696a-4fef-888a-fbbeaf04661b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:52.516766 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75ff0ca8-696a-4fef-888a-fbbeaf04661b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:52.517447 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75ff0ca8-696a-4fef-888a-fbbeaf04661b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:52.518530 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75ff0ca8-696a-4fef-888a-fbbeaf04661b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:52.519356 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-75ff0ca8-696a-4fef-888a-fbbeaf04661b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:52.569872 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-75ff0ca8-696a-4fef-888a-fbbeaf04661b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/ips" status: 200 len: 149 microversion: 2.1 time: 0.083928 Jul 25 16:36:52.571072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 469/904] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:36:52 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/ips => generated 149 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:36:54.278465 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=11 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:54.280041 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=27 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:36:54.284585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-92625200-a8f9-4ab6-ab05-744afecf0436 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa55438a-89f9-40dc-bae6-5690b26717b8"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:36:54.287472 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-92625200-a8f9-4ab6-ab05-744afecf0436 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:36:54.295945 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92625200-a8f9-4ab6-ab05-744afecf0436 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:54.296433 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92625200-a8f9-4ab6-ab05-744afecf0436 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:54.297286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92625200-a8f9-4ab6-ab05-744afecf0436 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:36:54.297827 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-92625200-a8f9-4ab6-ab05-744afecf0436 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:36:54.688130 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-92625200-a8f9-4ab6-ab05-744afecf0436 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410746 Jul 25 16:36:54.689288 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 436/905] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:36:54 2022] POST /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:37:01.538150 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-3eae8ad6-2b88-46d2-99b8-cc4b0afd022f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: .version_select at 0x7f440a585280>, body: {"keypair": {"name": "tempest-keypair-31326460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNNlcIDJ8SQLfcW0pn3haFEJ80n22EniWXXGIH5gHej75dMa/kdDhO0tOm+if7YpW+P6QAW6PcwaXeihU0zDVyX8wXJ26/ZNk86+LITFUyYePIQxSm544joEAZpuXbLIA=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:01.569510 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-3eae8ad6-2b88-46d2-99b8-cc4b0afd022f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for project 7ad628e26f9349e59d73f6606242d957. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:37:01.577581 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-3eae8ad6-2b88-46d2-99b8-cc4b0afd022f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for user 1f86305f296440bcae5268e1a0c8b089 and project 7ad628e26f9349e59d73f6606242d957. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:37:01.623797 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-3eae8ad6-2b88-46d2-99b8-cc4b0afd022f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.093013 Jul 25 16:37:01.624721 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 470/906] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:37:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:04.128905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-820045345", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efa07ab3-0bdf-47e0-83af-e1fbc262fab3"}], "security_groups": [{"name": "tempest-securitygroup--446647442"}], "key_name": "tempest-keypair-31326460", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:04.333859 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] validate_networks() for [('efa07ab3-0bdf-47e0-83af-e1fbc262fab3', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:37:04.670458 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:04.994523 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:37:04.995144 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:37:04.995681 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:37:04.996195 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:37:04.996650 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:37:05.010793 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:05.011460 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:05.012864 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:05.013602 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:05.043681 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for project 7ad628e26f9349e59d73f6606242d957. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:37:05.049930 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for user 1f86305f296440bcae5268e1a0c8b089 and project 7ad628e26f9349e59d73f6606242d957. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:37:05.072806 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:37:05.077500 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:37:05.150369 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-86ae95aa-37da-4311-a737-a391b85704ab tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.029174 Jul 25 16:37:05.151518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 437/907] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:37:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:37:05.167252 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=4 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:05.173946 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-cc36cb4f-d506-4e0c-b177-f6350f074840 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:05.175591 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-cc36cb4f-d506-4e0c-b177-f6350f074840 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:05.289141 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-cc36cb4f-d506-4e0c-b177-f6350f074840 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:05.301999 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-cc36cb4f-d506-4e0c-b177-f6350f074840 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1239 microversion: 2.1 time: 0.137996 Jul 25 16:37:05.302904 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 471/908] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:05 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1239 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:06.336056 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-15c4182b-684a-4a86-88a5-aed7efbb240e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:06.338879 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-15c4182b-684a-4a86-88a5-aed7efbb240e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:06.351469 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15c4182b-684a-4a86-88a5-aed7efbb240e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:06.352273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15c4182b-684a-4a86-88a5-aed7efbb240e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:06.353779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15c4182b-684a-4a86-88a5-aed7efbb240e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:06.354736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-15c4182b-684a-4a86-88a5-aed7efbb240e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:06.486411 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-15c4182b-684a-4a86-88a5-aed7efbb240e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:06.497586 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-15c4182b-684a-4a86-88a5-aed7efbb240e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1291 microversion: 2.1 time: 0.167796 Jul 25 16:37:06.498911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 438/909] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:06 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1291 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:07.532954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ab02b845-640d-4f24-b326-50c3bc0fd758 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:07.534149 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ab02b845-640d-4f24-b326-50c3bc0fd758 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:07.547140 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab02b845-640d-4f24-b326-50c3bc0fd758 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:07.547948 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab02b845-640d-4f24-b326-50c3bc0fd758 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:07.549453 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab02b845-640d-4f24-b326-50c3bc0fd758 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:07.550237 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ab02b845-640d-4f24-b326-50c3bc0fd758 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:07.658612 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-ab02b845-640d-4f24-b326-50c3bc0fd758 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:07.682174 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ab02b845-640d-4f24-b326-50c3bc0fd758 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1297 microversion: 2.1 time: 0.155123 Jul 25 16:37:07.683624 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 472/910] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:07 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:08.709156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6adb4540-533c-46c0-86e3-6b1db2956226 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:08.710031 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6adb4540-533c-46c0-86e3-6b1db2956226 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:08.720905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6adb4540-533c-46c0-86e3-6b1db2956226 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:08.721641 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6adb4540-533c-46c0-86e3-6b1db2956226 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:08.723068 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6adb4540-533c-46c0-86e3-6b1db2956226 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:08.724518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6adb4540-533c-46c0-86e3-6b1db2956226 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:08.915806 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-6adb4540-533c-46c0-86e3-6b1db2956226 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:08.931243 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6adb4540-533c-46c0-86e3-6b1db2956226 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1364 microversion: 2.1 time: 0.225866 Jul 25 16:37:08.935405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 439/911] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:08 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:09.510157 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-1b817900-6d27-4b6b-a03e-bf47bf746529 req-fe604333-dc94-4bb5-963b-c984295c7bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d5a977-0b82-421e-bb5d-e8fec6042129", "tag": "45a92947-4147-4e87-ad91-44ae45def770"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:09.532749 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1b817900-6d27-4b6b-a03e-bf47bf746529 req-fe604333-dc94-4bb5-963b-c984295c7bf3 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:09.533863 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1b817900-6d27-4b6b-a03e-bf47bf746529 req-fe604333-dc94-4bb5-963b-c984295c7bf3 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:09.560682 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-1b817900-6d27-4b6b-a03e-bf47bf746529 req-fe604333-dc94-4bb5-963b-c984295c7bf3 service nova] Creating event network-changed:45a92947-4147-4e87-ad91-44ae45def770 for instance e6d5a977-0b82-421e-bb5d-e8fec6042129 on hv-cinder-83697 Jul 25 16:37:09.572348 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-1b817900-6d27-4b6b-a03e-bf47bf746529 req-fe604333-dc94-4bb5-963b-c984295c7bf3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090859 Jul 25 16:37:09.573411 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 473/912] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:09.959898 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-87e578ad-7080-47d0-884e-91c82bb5ee72 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:09.961115 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-87e578ad-7080-47d0-884e-91c82bb5ee72 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:09.970446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87e578ad-7080-47d0-884e-91c82bb5ee72 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:09.971286 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87e578ad-7080-47d0-884e-91c82bb5ee72 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:09.972826 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87e578ad-7080-47d0-884e-91c82bb5ee72 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:09.973603 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-87e578ad-7080-47d0-884e-91c82bb5ee72 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:10.191843 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-87e578ad-7080-47d0-884e-91c82bb5ee72 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:10.201242 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-87e578ad-7080-47d0-884e-91c82bb5ee72 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1364 microversion: 2.1 time: 0.247625 Jul 25 16:37:10.202425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 440/913] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:09 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:11.228339 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1b9516ea-fdfb-4033-a665-218fa18c1241 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:11.229253 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1b9516ea-fdfb-4033-a665-218fa18c1241 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:11.238596 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b9516ea-fdfb-4033-a665-218fa18c1241 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:11.239033 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b9516ea-fdfb-4033-a665-218fa18c1241 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:11.239826 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b9516ea-fdfb-4033-a665-218fa18c1241 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:11.241262 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b9516ea-fdfb-4033-a665-218fa18c1241 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:11.429896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-1b9516ea-fdfb-4033-a665-218fa18c1241 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:11.448424 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1b9516ea-fdfb-4033-a665-218fa18c1241 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1364 microversion: 2.1 time: 0.226585 Jul 25 16:37:11.449443 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 474/914] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:11 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:12.478774 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-8509e251-02a7-424d-b8b1-9ef6ed0c4ee5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:12.479464 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-8509e251-02a7-424d-b8b1-9ef6ed0c4ee5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:12.487437 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8509e251-02a7-424d-b8b1-9ef6ed0c4ee5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:12.488006 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8509e251-02a7-424d-b8b1-9ef6ed0c4ee5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:12.488794 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8509e251-02a7-424d-b8b1-9ef6ed0c4ee5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:12.489204 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-8509e251-02a7-424d-b8b1-9ef6ed0c4ee5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:12.691229 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-8509e251-02a7-424d-b8b1-9ef6ed0c4ee5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:12.704913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-8509e251-02a7-424d-b8b1-9ef6ed0c4ee5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1364 microversion: 2.1 time: 0.230324 Jul 25 16:37:12.705908 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 441/915] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:12 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:13.515382 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-3507618d-4ebb-4503-b31b-6dc8dcd02bb5 req-671985f0-1b7c-4305-9bc0-ec2b8805241e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d5a977-0b82-421e-bb5d-e8fec6042129", "name": "network-vif-plugged", "status": "completed", "tag": "45a92947-4147-4e87-ad91-44ae45def770"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:13.526478 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-3507618d-4ebb-4503-b31b-6dc8dcd02bb5 req-671985f0-1b7c-4305-9bc0-ec2b8805241e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:13.526925 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-3507618d-4ebb-4503-b31b-6dc8dcd02bb5 req-671985f0-1b7c-4305-9bc0-ec2b8805241e service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:13.545912 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-3507618d-4ebb-4503-b31b-6dc8dcd02bb5 req-671985f0-1b7c-4305-9bc0-ec2b8805241e service nova] Creating event network-vif-plugged:45a92947-4147-4e87-ad91-44ae45def770 for instance e6d5a977-0b82-421e-bb5d-e8fec6042129 on hv-cinder-83697 Jul 25 16:37:13.555816 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-3507618d-4ebb-4503-b31b-6dc8dcd02bb5 req-671985f0-1b7c-4305-9bc0-ec2b8805241e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044714 Jul 25 16:37:13.556847 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 475/916] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:37:13.741208 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-047f1984-056e-499e-9865-5986d1d3a67d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:13.742123 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-047f1984-056e-499e-9865-5986d1d3a67d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:13.749941 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-047f1984-056e-499e-9865-5986d1d3a67d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:13.750387 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-047f1984-056e-499e-9865-5986d1d3a67d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:13.751191 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-047f1984-056e-499e-9865-5986d1d3a67d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:13.751623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-047f1984-056e-499e-9865-5986d1d3a67d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:13.932047 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-047f1984-056e-499e-9865-5986d1d3a67d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:13.941061 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-047f1984-056e-499e-9865-5986d1d3a67d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1364 microversion: 2.1 time: 0.204475 Jul 25 16:37:13.941808 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 442/917] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:13 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:14.973082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d9eb5f2b-f9b7-440a-ba2e-586aa330dbbc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:14.973805 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d9eb5f2b-f9b7-440a-ba2e-586aa330dbbc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:14.986201 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9eb5f2b-f9b7-440a-ba2e-586aa330dbbc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:14.987092 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9eb5f2b-f9b7-440a-ba2e-586aa330dbbc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:14.988907 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9eb5f2b-f9b7-440a-ba2e-586aa330dbbc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:14.989656 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d9eb5f2b-f9b7-440a-ba2e-586aa330dbbc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:15.178683 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d9eb5f2b-f9b7-440a-ba2e-586aa330dbbc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:15.190850 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d9eb5f2b-f9b7-440a-ba2e-586aa330dbbc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1554 microversion: 2.1 time: 0.224131 Jul 25 16:37:15.191478 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 476/918] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:14 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:15.217290 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-30349409-1b1a-448f-a280-72fdb69d9612 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:15.218234 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-30349409-1b1a-448f-a280-72fdb69d9612 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:15.221623 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:15.222615 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:15.235609 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30349409-1b1a-448f-a280-72fdb69d9612 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:15.236501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30349409-1b1a-448f-a280-72fdb69d9612 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:15.238034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30349409-1b1a-448f-a280-72fdb69d9612 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:15.238893 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30349409-1b1a-448f-a280-72fdb69d9612 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:15.339726 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-30349409-1b1a-448f-a280-72fdb69d9612 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128466 Jul 25 16:37:15.340344 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 443/919] 10.222.0.66 () {58 vars in 1275 bytes} [Mon Jul 25 16:37:15 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:37:16.564625 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-8c1d6e5d-b827-42b9-bdc5-9613ce10a2ce req-a840ba78-a7ab-4d71-b3dc-a18f74238902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d5a977-0b82-421e-bb5d-e8fec6042129", "tag": "45a92947-4147-4e87-ad91-44ae45def770"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:16.570166 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:16.577553 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8c1d6e5d-b827-42b9-bdc5-9613ce10a2ce req-a840ba78-a7ab-4d71-b3dc-a18f74238902 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:16.578082 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-8c1d6e5d-b827-42b9-bdc5-9613ce10a2ce req-a840ba78-a7ab-4d71-b3dc-a18f74238902 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:16.591593 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-8c1d6e5d-b827-42b9-bdc5-9613ce10a2ce req-a840ba78-a7ab-4d71-b3dc-a18f74238902 service nova] Creating event network-changed:45a92947-4147-4e87-ad91-44ae45def770 for instance e6d5a977-0b82-421e-bb5d-e8fec6042129 on hv-cinder-83697 Jul 25 16:37:16.597883 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-8c1d6e5d-b827-42b9-bdc5-9613ce10a2ce req-a840ba78-a7ab-4d71-b3dc-a18f74238902 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037113 Jul 25 16:37:16.598665 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 477/920] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:37:31.638399 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:31.645685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-144478ab-70ba-40a7-80d1-be573476813e req-932da594-fe06-48ef-bdf1-e14df5910ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54d3f0f-e102-438c-aac9-c9f4ddc62bf0", "tag": "4b1fbfc5-127d-402f-9670-ae5c5bf444c1"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:31.653042 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=36 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:31.657448 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-f80c764e-72d9-48e7-92ae-ec0f5b70ecf1 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:31.657959 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f80c764e-72d9-48e7-92ae-ec0f5b70ecf1 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:31.662498 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:31.663543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=24 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:37:31.675666 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-144478ab-70ba-40a7-80d1-be573476813e req-932da594-fe06-48ef-bdf1-e14df5910ba9 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:31.676321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-144478ab-70ba-40a7-80d1-be573476813e req-932da594-fe06-48ef-bdf1-e14df5910ba9 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:31.681526 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f80c764e-72d9-48e7-92ae-ec0f5b70ecf1 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:31.682159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f80c764e-72d9-48e7-92ae-ec0f5b70ecf1 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:31.683661 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f80c764e-72d9-48e7-92ae-ec0f5b70ecf1 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:31.684423 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-f80c764e-72d9-48e7-92ae-ec0f5b70ecf1 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:31.694467 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-144478ab-70ba-40a7-80d1-be573476813e req-932da594-fe06-48ef-bdf1-e14df5910ba9 service nova] Creating event network-changed:4b1fbfc5-127d-402f-9670-ae5c5bf444c1 for instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 on hv-cinder-83697 Jul 25 16:37:31.701937 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-144478ab-70ba-40a7-80d1-be573476813e req-932da594-fe06-48ef-bdf1-e14df5910ba9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060652 Jul 25 16:37:31.705567 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 478/921] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:31.744472 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-f80c764e-72d9-48e7-92ae-ec0f5b70ecf1 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:37:31.895065 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-f80c764e-72d9-48e7-92ae-ec0f5b70ecf1 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 204 len: 0 microversion: 2.1 time: 0.257556 Jul 25 16:37:31.897277 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 444/922] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:37:31 2022] DELETE /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:37:31.912658 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-118d8a40-ace5-4620-855f-dd6324bddf5d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:31.913441 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-118d8a40-ace5-4620-855f-dd6324bddf5d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:31.926921 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-118d8a40-ace5-4620-855f-dd6324bddf5d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:31.927839 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-118d8a40-ace5-4620-855f-dd6324bddf5d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:31.929379 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-118d8a40-ace5-4620-855f-dd6324bddf5d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:31.930104 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-118d8a40-ace5-4620-855f-dd6324bddf5d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:32.157963 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-118d8a40-ace5-4620-855f-dd6324bddf5d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:32.172205 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-118d8a40-ace5-4620-855f-dd6324bddf5d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1576 microversion: 2.1 time: 0.268310 Jul 25 16:37:32.173250 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 479/923] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:31 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1576 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:33.210894 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-4b383c57-70bc-414e-b315-1c74d17658f0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:33.212303 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-4b383c57-70bc-414e-b315-1c74d17658f0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:33.223823 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b383c57-70bc-414e-b315-1c74d17658f0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:33.224918 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b383c57-70bc-414e-b315-1c74d17658f0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:33.226561 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b383c57-70bc-414e-b315-1c74d17658f0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:33.227521 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-4b383c57-70bc-414e-b315-1c74d17658f0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:33.473410 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-4b383c57-70bc-414e-b315-1c74d17658f0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:33.483586 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-4b383c57-70bc-414e-b315-1c74d17658f0 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1576 microversion: 2.1 time: 0.280850 Jul 25 16:37:33.484560 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 445/924] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:33 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1576 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:34.227981 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-b4e419a3-7b8b-439b-8cb6-3ac014c05339 req-3020c290-446e-469d-b40b-e77e261a68f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54d3f0f-e102-438c-aac9-c9f4ddc62bf0", "name": "network-vif-deleted", "tag": "4b1fbfc5-127d-402f-9670-ae5c5bf444c1"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:34.240067 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b4e419a3-7b8b-439b-8cb6-3ac014c05339 req-3020c290-446e-469d-b40b-e77e261a68f7 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:34.240533 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-b4e419a3-7b8b-439b-8cb6-3ac014c05339 req-3020c290-446e-469d-b40b-e77e261a68f7 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:34.257518 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-b4e419a3-7b8b-439b-8cb6-3ac014c05339 req-3020c290-446e-469d-b40b-e77e261a68f7 service nova] Creating event network-vif-deleted:4b1fbfc5-127d-402f-9670-ae5c5bf444c1 for instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 on hv-cinder-83697 Jul 25 16:37:34.266113 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-b4e419a3-7b8b-439b-8cb6-3ac014c05339 req-3020c290-446e-469d-b40b-e77e261a68f7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041598 Jul 25 16:37:34.267263 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 480/925] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:34.508994 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-753bcb6c-ad0a-4070-a837-4814fa928eeb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:34.509993 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-753bcb6c-ad0a-4070-a837-4814fa928eeb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:34.517633 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-753bcb6c-ad0a-4070-a837-4814fa928eeb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:34.518451 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-753bcb6c-ad0a-4070-a837-4814fa928eeb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:34.519266 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-753bcb6c-ad0a-4070-a837-4814fa928eeb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:34.519707 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-753bcb6c-ad0a-4070-a837-4814fa928eeb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:34.650977 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-753bcb6c-ad0a-4070-a837-4814fa928eeb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:34.660267 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-753bcb6c-ad0a-4070-a837-4814fa928eeb tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 200 len: 1225 microversion: 2.1 time: 0.155936 Jul 25 16:37:34.661067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 446/926] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:34 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:35.684927 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:35.685552 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: a54d3f0f-e102-438c-aac9-c9f4ddc62bf0] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:35.693148 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:35.693631 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:35.694468 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:35.694892 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:35.715351 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] HTTP exception thrown: Instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 could not be found. Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Request method failure captured: Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 HTTP/1.1 Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sUuR8gjMYGrz6BMvzyUCInOpq0sePI-03iNk8KIAssGS_g50O29c7-wqrIBMkDxVjcQ8x1HXW4q4yyxm8a2u1uVouqXRYNC4gFcUNPL2ndnYcNywGKUAaFnX5xg_zMpS7BvtDgdyMLZ3LVII5v9LoKIXjV4PSsSLQo0WZYSSUa2hJM Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:37:35.717524 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ee2c762eec4646afbd0ea4d71a58894d"}]}] Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: d3eebc82ce654013998f58585c123a0e Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 could not be found. Jul 25 16:37:35.720329 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'a54d3f0f-e102-438c-aac9-c9f4ddc62bf0'} Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 could not be found. Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:37:35.721970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 could not be found. Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 could not be found. Jul 25 16:37:35.724541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:35.726823 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Returning 404 to user: Instance a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:37:35.726823 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-82da6484-d1e1-4bc4-813a-d9b284ca16a3 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0" status: 404 len: 111 microversion: 2.1 time: 0.039370 Jul 25 16:37:35.726823 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 481/927] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:35 2022] GET /compute/v2.1/servers/a54d3f0f-e102-438c-aac9-c9f4ddc62bf0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:37:39.133602 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-49c64966-2eb8-45d2-a479-a883faac4a26 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:39.134476 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-49c64966-2eb8-45d2-a479-a883faac4a26 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:39.141075 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-a2773486-f1bb-4f7f-976f-3eb71c18e5e6 req-38d1f95c-0d90-4a68-82c6-96efe7326785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b121aac-331b-4b85-b094-6591366409a6", "tag": "1d784ffa-ce5c-4955-a5dd-9e70c917f66c"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:39.142059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49c64966-2eb8-45d2-a479-a883faac4a26 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:39.142236 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49c64966-2eb8-45d2-a479-a883faac4a26 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:39.142880 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49c64966-2eb8-45d2-a479-a883faac4a26 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:39.143314 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-49c64966-2eb8-45d2-a479-a883faac4a26 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:39.161770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-a2773486-f1bb-4f7f-976f-3eb71c18e5e6 req-38d1f95c-0d90-4a68-82c6-96efe7326785 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:39.162950 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-a2773486-f1bb-4f7f-976f-3eb71c18e5e6 req-38d1f95c-0d90-4a68-82c6-96efe7326785 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:39.174129 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-49c64966-2eb8-45d2-a479-a883faac4a26 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:37:39.185919 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-a2773486-f1bb-4f7f-976f-3eb71c18e5e6 req-38d1f95c-0d90-4a68-82c6-96efe7326785 service nova] Creating event network-changed:1d784ffa-ce5c-4955-a5dd-9e70c917f66c for instance 1b121aac-331b-4b85-b094-6591366409a6 on hv-cinder-83697 Jul 25 16:37:39.195048 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-a2773486-f1bb-4f7f-976f-3eb71c18e5e6 req-38d1f95c-0d90-4a68-82c6-96efe7326785 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060875 Jul 25 16:37:39.196233 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 482/928] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:39.319569 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-49c64966-2eb8-45d2-a479-a883faac4a26 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 204 len: 0 microversion: 2.1 time: 0.189787 Jul 25 16:37:39.320913 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 447/929] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:37:39 2022] DELETE /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:37:39.331508 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-786dad4e-fa4e-4f7f-9161-2ef2a751da25 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:39.336541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-786dad4e-fa4e-4f7f-9161-2ef2a751da25 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:39.358151 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-786dad4e-fa4e-4f7f-9161-2ef2a751da25 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:39.359871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-786dad4e-fa4e-4f7f-9161-2ef2a751da25 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:39.362641 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-786dad4e-fa4e-4f7f-9161-2ef2a751da25 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:39.363536 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-786dad4e-fa4e-4f7f-9161-2ef2a751da25 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:39.538117 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-786dad4e-fa4e-4f7f-9161-2ef2a751da25 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:39.546489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-786dad4e-fa4e-4f7f-9161-2ef2a751da25 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1577 microversion: 2.1 time: 0.220345 Jul 25 16:37:39.547589 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 483/930] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:39 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:40.571317 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-459983d8-d39f-4ee4-83fa-d3b1ba7820fa tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:40.572147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-459983d8-d39f-4ee4-83fa-d3b1ba7820fa tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:40.579362 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-459983d8-d39f-4ee4-83fa-d3b1ba7820fa tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:40.579719 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-459983d8-d39f-4ee4-83fa-d3b1ba7820fa tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:40.580498 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-459983d8-d39f-4ee4-83fa-d3b1ba7820fa tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:40.580919 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-459983d8-d39f-4ee4-83fa-d3b1ba7820fa tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:40.770368 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-459983d8-d39f-4ee4-83fa-d3b1ba7820fa tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:40.781634 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-459983d8-d39f-4ee4-83fa-d3b1ba7820fa tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1577 microversion: 2.1 time: 0.215270 Jul 25 16:37:40.782604 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 448/931] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:40 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:41.493685 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-1057b8b8-8dbc-44cd-84fa-ae02fa7d38d9 req-92f54e78-51eb-41c5-a050-df9a186499c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b121aac-331b-4b85-b094-6591366409a6", "name": "network-vif-deleted", "tag": "1d784ffa-ce5c-4955-a5dd-9e70c917f66c"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:41.508970 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1057b8b8-8dbc-44cd-84fa-ae02fa7d38d9 req-92f54e78-51eb-41c5-a050-df9a186499c2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:41.509504 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-1057b8b8-8dbc-44cd-84fa-ae02fa7d38d9 req-92f54e78-51eb-41c5-a050-df9a186499c2 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:41.523247 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-1057b8b8-8dbc-44cd-84fa-ae02fa7d38d9 req-92f54e78-51eb-41c5-a050-df9a186499c2 service nova] Creating event network-vif-deleted:1d784ffa-ce5c-4955-a5dd-9e70c917f66c for instance 1b121aac-331b-4b85-b094-6591366409a6 on hv-cinder-83697 Jul 25 16:37:41.531509 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-1057b8b8-8dbc-44cd-84fa-ae02fa7d38d9 req-92f54e78-51eb-41c5-a050-df9a186499c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042153 Jul 25 16:37:41.532319 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 484/932] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:37:41.821526 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:41.822863 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:41.835467 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:41.836838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:41.838694 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:41.839816 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:41.899752 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:41.900486 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:41.900974 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lazy-loading 'fault' on Instance uuid 1b121aac-331b-4b85-b094-6591366409a6 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:37:41.952824 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3eebc82ce654013998f58585c123a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2c762eec4646afbd0ea4d71a58894d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:41.961943 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fb0c446d-418c-4cbe-a477-8bac4ee0feed tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 200 len: 1229 microversion: 2.1 time: 0.153135 Jul 25 16:37:41.962543 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 449/933] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:41 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 1229 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:42.997914 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:42.998637 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 1b121aac-331b-4b85-b094-6591366409a6] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:43.005169 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.005724 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.006498 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.006929 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.022431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] HTTP exception thrown: Instance 1b121aac-331b-4b85-b094-6591366409a6 could not be found. Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Request method failure captured: Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 HTTP/1.1 Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sUuR8gjMYGrz6BMvzyUCInOpq0sePI-03iNk8KIAssGS_g50O29c7-wqrIBMkDxVjcQ8x1HXW4q4yyxm8a2u1uVouqXRYNC4gFcUNPL2ndnYcNywGKUAaFnX5xg_zMpS7BvtDgdyMLZ3LVII5v9LoKIXjV4PSsSLQo0WZYSSUa2hJM Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:37:43.024132 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ee2c762eec4646afbd0ea4d71a58894d"}]}] Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: d3eebc82ce654013998f58585c123a0e Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 1b121aac-331b-4b85-b094-6591366409a6 could not be found. Jul 25 16:37:43.026599 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '1b121aac-331b-4b85-b094-6591366409a6'} Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b121aac-331b-4b85-b094-6591366409a6 could not be found. Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:37:43.027988 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b121aac-331b-4b85-b094-6591366409a6 could not be found. Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b121aac-331b-4b85-b094-6591366409a6 could not be found. Jul 25 16:37:43.030355 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.033004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Returning 404 to user: Instance 1b121aac-331b-4b85-b094-6591366409a6 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:37:43.033004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-adba5ac6-f97d-429a-8fe0-f247bd748f91 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6" status: 404 len: 111 microversion: 2.1 time: 0.032861 Jul 25 16:37:43.033004 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 485/934] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:42 2022] GET /compute/v2.1/servers/1b121aac-331b-4b85-b094-6591366409a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:37:43.591059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:43.591720 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:43.599068 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.599501 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.600287 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.600717 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.616222 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] HTTP exception thrown: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Request method failure captured: Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a HTTP/1.1 Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sUuR8gjMYGrz6BMvzyUCInOpq0sePI-03iNk8KIAssGS_g50O29c7-wqrIBMkDxVjcQ8x1HXW4q4yyxm8a2u1uVouqXRYNC4gFcUNPL2ndnYcNywGKUAaFnX5xg_zMpS7BvtDgdyMLZ3LVII5v9LoKIXjV4PSsSLQo0WZYSSUa2hJM Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:37:43.617981 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ee2c762eec4646afbd0ea4d71a58894d"}]}] Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: d3eebc82ce654013998f58585c123a0e Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.620905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '8757e6e3-9388-4e11-9060-a1e8b7e2192a'} Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:37:43.622847 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.625815 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.628611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Returning 404 to user: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:37:43.628611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5404870a-27cb-4037-be98-9df9772f5ff7 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 404 len: 111 microversion: 2.1 time: 0.032503 Jul 25 16:37:43.628611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 450/935] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:37:43 2022] DELETE /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:37:43.633371 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:43.634253 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] [instance: 8757e6e3-9388-4e11-9060-a1e8b7e2192a] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:43.644644 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.645504 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.646915 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:43.647700 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:43.666379 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] HTTP exception thrown: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Request method failure captured: Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a HTTP/1.1 Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sUuR8gjMYGrz6BMvzyUCInOpq0sePI-03iNk8KIAssGS_g50O29c7-wqrIBMkDxVjcQ8x1HXW4q4yyxm8a2u1uVouqXRYNC4gFcUNPL2ndnYcNywGKUAaFnX5xg_zMpS7BvtDgdyMLZ3LVII5v9LoKIXjV4PSsSLQo0WZYSSUa2hJM Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:37:43.667897 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ee2c762eec4646afbd0ea4d71a58894d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ee2c762eec4646afbd0ea4d71a58894d"}]}] Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: ee2c762eec4646afbd0ea4d71a58894d Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-TestVolumeBootPattern-350844036 Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: d3eebc82ce654013998f58585c123a0e Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-TestVolumeBootPattern-350844036-project Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.670886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '8757e6e3-9388-4e11-9060-a1e8b7e2192a'} Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:37:43.672337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. Jul 25 16:37:43.674878 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:37:43.677327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Returning 404 to user: Instance 8757e6e3-9388-4e11-9060-a1e8b7e2192a could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:37:43.677327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0da2f94a-8f01-4466-b5d4-45b814c73390 tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a" status: 404 len: 111 microversion: 2.1 time: 0.042886 Jul 25 16:37:43.677327 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 486/936] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:43 2022] GET /compute/v2.1/servers/8757e6e3-9388-4e11-9060-a1e8b7e2192a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:37:45.038769 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-66cd057e-ecc3-492c-b93e-073a77fe704d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] Calling method '.version_select at 0x7f440aed54c0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:45.063451 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-66cd057e-ecc3-492c-b93e-073a77fe704d tempest-TestVolumeBootPattern-350844036 tempest-TestVolumeBootPattern-350844036-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-241383450" status: 202 len: 0 microversion: 2.1 time: 0.029304 Jul 25 16:37:45.064201 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 451/937] 10.222.0.66 () {58 vars in 1260 bytes} [Mon Jul 25 16:37:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-241383450 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:37:51.919102 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9014f664-6d2d-46ef-9e1f-57a1abae07d7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:51.919786 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9014f664-6d2d-46ef-9e1f-57a1abae07d7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:51.927997 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9014f664-6d2d-46ef-9e1f-57a1abae07d7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:51.929070 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9014f664-6d2d-46ef-9e1f-57a1abae07d7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:51.930140 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9014f664-6d2d-46ef-9e1f-57a1abae07d7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:51.930752 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9014f664-6d2d-46ef-9e1f-57a1abae07d7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:51.959204 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9014f664-6d2d-46ef-9e1f-57a1abae07d7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129/ips" status: 200 len: 150 microversion: 2.1 time: 0.044598 Jul 25 16:37:51.960240 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 487/938] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:37:51 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:51.977394 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa55438a-89f9-40dc-bae6-5690b26717b8"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:51.979982 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:51.989152 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:51.989771 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:51.990893 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:51.991817 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:52.133955 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Invalid volume: volume fa55438a-89f9-40dc-bae6-5690b26717b8 is already attached to instances: 05732003-19e7-4e32-83f9-a73b782ef373 Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129/os-volume_attachments HTTP/1.1 Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 74 Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:37:52.135744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {"volumeAttachment": {"volumeId": "fa55438a-89f9-40dc-bae6-5690b26717b8"}} Jul 25 16:37:52.138856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Invalid volume: volume fa55438a-89f9-40dc-bae6-5690b26717b8 is already attached to instances: 05732003-19e7-4e32-83f9-a73b782ef373 Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'server_id': 'e6d5a977-0b82-421e-bb5d-e8fec6042129', 'body': {'volumeAttachment': {'volumeId': 'fa55438a-89f9-40dc-bae6-5690b26717b8'}}} Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fa55438a-89f9-40dc-bae6-5690b26717b8 is already attached to instances: 05732003-19e7-4e32-83f9-a73b782ef373 Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:52.140949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fa55438a-89f9-40dc-bae6-5690b26717b8 is already attached to instances: 05732003-19e7-4e32-83f9-a73b782ef373 Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:52.143446 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:52.146875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:52.146875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:37:52.146875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:37:52.146875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fa55438a-89f9-40dc-bae6-5690b26717b8 is already attached to instances: 05732003-19e7-4e32-83f9-a73b782ef373 Jul 25 16:37:52.146875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:52.146875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 400 to user: Invalid volume: volume fa55438a-89f9-40dc-bae6-5690b26717b8 is already attached to instances: 05732003-19e7-4e32-83f9-a73b782ef373 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:37:52.146875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5ae8a743-8960-4e69-86a7-5d43f24a2817 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.165068 Jul 25 16:37:52.146875 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 452/939] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:37:51 2022] POST /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129/os-volume_attachments => generated 174 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 16:37:52.157156 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7c14ec9a-bc47-4f96-b4b8-b11b20d0359f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:52.158266 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7c14ec9a-bc47-4f96-b4b8-b11b20d0359f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:52.179770 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c14ec9a-bc47-4f96-b4b8-b11b20d0359f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:52.180622 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c14ec9a-bc47-4f96-b4b8-b11b20d0359f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:52.182072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c14ec9a-bc47-4f96-b4b8-b11b20d0359f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:52.182810 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7c14ec9a-bc47-4f96-b4b8-b11b20d0359f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:52.229807 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7c14ec9a-bc47-4f96-b4b8-b11b20d0359f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:37:52.329036 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7c14ec9a-bc47-4f96-b4b8-b11b20d0359f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 204 len: 0 microversion: 2.1 time: 0.179022 Jul 25 16:37:52.329755 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 488/940] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:37:52 2022] DELETE /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:37:52.343175 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-30efef3e-185a-4b51-9db3-ded489e0bbe6 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:52.343982 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-30efef3e-185a-4b51-9db3-ded489e0bbe6 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:52.352611 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30efef3e-185a-4b51-9db3-ded489e0bbe6 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:52.353201 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30efef3e-185a-4b51-9db3-ded489e0bbe6 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:52.354315 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30efef3e-185a-4b51-9db3-ded489e0bbe6 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:52.354745 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-30efef3e-185a-4b51-9db3-ded489e0bbe6 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:52.580980 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-30efef3e-185a-4b51-9db3-ded489e0bbe6 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:52.590856 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-30efef3e-185a-4b51-9db3-ded489e0bbe6 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1679 microversion: 2.1 time: 0.252519 Jul 25 16:37:52.591544 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 453/941] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:52 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:37:53.630903 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-8ec4c78c-b8da-4985-880c-ad8b92434f05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:53.633161 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-8ec4c78c-b8da-4985-880c-ad8b92434f05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:53.641990 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ec4c78c-b8da-4985-880c-ad8b92434f05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:53.642714 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ec4c78c-b8da-4985-880c-ad8b92434f05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:53.643999 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ec4c78c-b8da-4985-880c-ad8b92434f05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:53.644717 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-8ec4c78c-b8da-4985-880c-ad8b92434f05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:53.968005 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-8ec4c78c-b8da-4985-880c-ad8b92434f05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:53.978811 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-8ec4c78c-b8da-4985-880c-ad8b92434f05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1679 microversion: 2.1 time: 0.355111 Jul 25 16:37:53.980048 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 489/942] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:53 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1679 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:54.925669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-7798c030-62f8-4866-8626-6ffb9e730070 req-e0ebd42a-a4fa-47b9-8ee3-a19036a465f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d5a977-0b82-421e-bb5d-e8fec6042129", "name": "network-vif-deleted", "tag": "45a92947-4147-4e87-ad91-44ae45def770"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:37:54.939585 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7798c030-62f8-4866-8626-6ffb9e730070 req-e0ebd42a-a4fa-47b9-8ee3-a19036a465f9 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:54.940375 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-7798c030-62f8-4866-8626-6ffb9e730070 req-e0ebd42a-a4fa-47b9-8ee3-a19036a465f9 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:54.960307 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-7798c030-62f8-4866-8626-6ffb9e730070 req-e0ebd42a-a4fa-47b9-8ee3-a19036a465f9 service nova] Creating event network-vif-deleted:45a92947-4147-4e87-ad91-44ae45def770 for instance e6d5a977-0b82-421e-bb5d-e8fec6042129 on hv-cinder-83697 Jul 25 16:37:54.969720 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-7798c030-62f8-4866-8626-6ffb9e730070 req-e0ebd42a-a4fa-47b9-8ee3-a19036a465f9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048171 Jul 25 16:37:54.970881 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 454/943] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:37:55.024929 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:55.025997 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:55.042756 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:55.043814 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:55.046777 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:55.047861 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:55.147926 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:55.148740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:55.149842 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lazy-loading 'fault' on Instance uuid e6d5a977-0b82-421e-bb5d-e8fec6042129 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:37:55.237676 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:55.251013 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-7a9d4c44-7828-4fc6-9007-b16642136137 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 200 len: 1329 microversion: 2.1 time: 0.233199 Jul 25 16:37:55.265777 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 490/944] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:55 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 1329 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:37:56.287813 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:56.288608 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:56.297539 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:56.297800 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:56.299174 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:56.299948 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:56.320380 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 HTTP/1.1 Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:37:56.322636 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:37:56.325779 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'e6d5a977-0b82-421e-bb5d-e8fec6042129'} Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:37:56.327373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:37:56.330057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:37:56.332592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:37:56.332592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-11b1dbc8-5924-4458-88a6-4a8beed3128f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 404 len: 111 microversion: 2.1 time: 0.041536 Jul 25 16:37:56.332592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 455/945] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:56 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:37:56.335520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-20acfec1-27c3-4257-a617-0b989fa663c9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '.version_select at 0x7f440a555040>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:56.360956 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-20acfec1-27c3-4257-a617-0b989fa663c9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-31326460" status: 202 len: 0 microversion: 2.1 time: 0.029706 Jul 25 16:37:56.361891 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 491/946] 10.222.0.66 () {58 vars in 1215 bytes} [Mon Jul 25 16:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-31326460 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:37:57.200232 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fab11f0e-db56-4fa9-96b3-916919f2c20d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:57.200754 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fab11f0e-db56-4fa9-96b3-916919f2c20d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:57.208811 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fab11f0e-db56-4fa9-96b3-916919f2c20d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:57.209318 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fab11f0e-db56-4fa9-96b3-916919f2c20d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:57.210359 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fab11f0e-db56-4fa9-96b3-916919f2c20d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:57.210828 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fab11f0e-db56-4fa9-96b3-916919f2c20d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:57.314949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.objects.instance [None req-fab11f0e-db56-4fa9-96b3-916919f2c20d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lazy-loading 'services' on Instance uuid 05732003-19e7-4e32-83f9-a73b782ef373 {{(pid=117920) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:37:57.420412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fab11f0e-db56-4fa9-96b3-916919f2c20d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-volume_attachments/fa55438a-89f9-40dc-bae6-5690b26717b8" status: 202 len: 0 microversion: 2.1 time: 0.224472 Jul 25 16:37:57.421619 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 456/947] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:37:57 2022] DELETE /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-volume_attachments/fa55438a-89f9-40dc-bae6-5690b26717b8 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:37:57.433050 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ed223e67-2b03-4dad-8b6a-14aec3528b0f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:57.436178 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ed223e67-2b03-4dad-8b6a-14aec3528b0f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:57.452009 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed223e67-2b03-4dad-8b6a-14aec3528b0f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:57.452482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed223e67-2b03-4dad-8b6a-14aec3528b0f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:57.453703 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed223e67-2b03-4dad-8b6a-14aec3528b0f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:57.454136 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ed223e67-2b03-4dad-8b6a-14aec3528b0f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:57.510746 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ed223e67-2b03-4dad-8b6a-14aec3528b0f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082106 Jul 25 16:37:57.517953 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 492/948] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:37:57 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:37:58.534679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-bc148a44-f4ac-4ecc-9d0c-2c315e2fb093 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:58.537393 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-bc148a44-f4ac-4ecc-9d0c-2c315e2fb093 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:58.545802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc148a44-f4ac-4ecc-9d0c-2c315e2fb093 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:58.546889 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc148a44-f4ac-4ecc-9d0c-2c315e2fb093 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:58.547113 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc148a44-f4ac-4ecc-9d0c-2c315e2fb093 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:58.547540 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-bc148a44-f4ac-4ecc-9d0c-2c315e2fb093 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:58.597863 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-bc148a44-f4ac-4ecc-9d0c-2c315e2fb093 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068388 Jul 25 16:37:58.598535 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 457/949] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:37:58 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:37:58.674687 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-1b937d97-47a5-4b3f-99c0-8e03a7fcc0cb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:58.675312 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1b937d97-47a5-4b3f-99c0-8e03a7fcc0cb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:58.683124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b937d97-47a5-4b3f-99c0-8e03a7fcc0cb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:58.683766 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b937d97-47a5-4b3f-99c0-8e03a7fcc0cb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:58.685373 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b937d97-47a5-4b3f-99c0-8e03a7fcc0cb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:58.685837 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-1b937d97-47a5-4b3f-99c0-8e03a7fcc0cb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:58.885226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-1b937d97-47a5-4b3f-99c0-8e03a7fcc0cb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Going to try to terminate instance {{(pid=117919) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:37:58.977094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-1b937d97-47a5-4b3f-99c0-8e03a7fcc0cb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 204 len: 0 microversion: 2.1 time: 0.306032 Jul 25 16:37:58.978179 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 493/950] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:37:58 2022] DELETE /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:37:58.990265 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cbcdb62c-29c2-4d88-b12f-125498ca9f65 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:37:58.990884 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cbcdb62c-29c2-4d88-b12f-125498ca9f65 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:37:58.998315 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbcdb62c-29c2-4d88-b12f-125498ca9f65 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:58.998763 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbcdb62c-29c2-4d88-b12f-125498ca9f65 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:58.999548 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbcdb62c-29c2-4d88-b12f-125498ca9f65 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:37:58.999997 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cbcdb62c-29c2-4d88-b12f-125498ca9f65 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:37:59.164720 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cbcdb62c-29c2-4d88-b12f-125498ca9f65 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:37:59.174205 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cbcdb62c-29c2-4d88-b12f-125498ca9f65 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1679 microversion: 2.1 time: 0.188290 Jul 25 16:37:59.175011 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 458/951] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:37:58 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:38:00.198778 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-da67c4ce-9d42-427d-a806-df415fb3fe18 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:00.199744 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-da67c4ce-9d42-427d-a806-df415fb3fe18 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:00.207434 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da67c4ce-9d42-427d-a806-df415fb3fe18 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:00.207891 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da67c4ce-9d42-427d-a806-df415fb3fe18 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:00.208880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da67c4ce-9d42-427d-a806-df415fb3fe18 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:00.209321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-da67c4ce-9d42-427d-a806-df415fb3fe18 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:00.364223 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-da67c4ce-9d42-427d-a806-df415fb3fe18 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:00.372946 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-da67c4ce-9d42-427d-a806-df415fb3fe18 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1679 microversion: 2.1 time: 0.178872 Jul 25 16:38:00.373675 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 494/952] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:00 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:01.402855 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-1265e726-03e1-4f02-9c96-7acb336a3c4b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:01.403959 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-1265e726-03e1-4f02-9c96-7acb336a3c4b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:01.418273 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1265e726-03e1-4f02-9c96-7acb336a3c4b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.418614 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1265e726-03e1-4f02-9c96-7acb336a3c4b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.419912 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1265e726-03e1-4f02-9c96-7acb336a3c4b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.420710 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-1265e726-03e1-4f02-9c96-7acb336a3c4b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.429298 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:01.540283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-1265e726-03e1-4f02-9c96-7acb336a3c4b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:01.551306 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1265e726-03e1-4f02-9c96-7acb336a3c4b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 200 len: 1613 microversion: 2.1 time: 0.155815 Jul 25 16:38:01.552058 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 459/953] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:01 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 1613 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:01.884537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-2ee77bd1-5fac-49be-b31f-ccc8357f8818 req-302e2d86-3e01-40da-b330-4211dfb084d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05732003-19e7-4e32-83f9-a73b782ef373", "name": "network-vif-deleted", "tag": "9ba4db95-9de2-4b0f-8120-7fce184d685e"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:01.891641 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:01.900386 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-2ee77bd1-5fac-49be-b31f-ccc8357f8818 req-302e2d86-3e01-40da-b330-4211dfb084d0 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:01.900921 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-2ee77bd1-5fac-49be-b31f-ccc8357f8818 req-302e2d86-3e01-40da-b330-4211dfb084d0 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:01.906718 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:01.919446 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-2ee77bd1-5fac-49be-b31f-ccc8357f8818 req-302e2d86-3e01-40da-b330-4211dfb084d0 service nova] Creating event network-vif-deleted:9ba4db95-9de2-4b0f-8120-7fce184d685e for instance 05732003-19e7-4e32-83f9-a73b782ef373 on hv-cinder-83697 Jul 25 16:38:01.926859 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-2ee77bd1-5fac-49be-b31f-ccc8357f8818 req-302e2d86-3e01-40da-b330-4211dfb084d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046843 Jul 25 16:38:01.928337 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 495/954] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:02.579290 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:02.580289 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:02.585090 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:02.595347 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:02.596412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:02.598057 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:02.599148 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:02.627089 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 HTTP/1.1 Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:38:02.630141 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:38:02.633147 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '05732003-19e7-4e32-83f9-a73b782ef373'} Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:38:02.634848 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:38:02.637584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:38:02.641238 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:38:02.642540 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-21fb890c-a3b1-4b1c-b87e-05f1888867a4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 404 len: 111 microversion: 2.1 time: 0.070133 Jul 25 16:38:02.655676 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-48351034-dab6-4e70-b743-4698d389b6cc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '.version_select at 0x7f440a5684c0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:02.658466 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 460/955] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:02 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:38:02.696368 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-48351034-dab6-4e70-b743-4698d389b6cc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034980774" status: 202 len: 0 microversion: 2.1 time: 0.046436 Jul 25 16:38:02.697448 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 496/956] 10.222.0.66 () {58 vars in 1221 bytes} [Mon Jul 25 16:38:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034980774 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:38:03.570037 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-71dc70b4-a230-4fd7-8dab-167d7ab4c01e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: .version_select at 0x7f440adcb8b0>, body: {"keypair": {"name": "tempest-keypair-2027801037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPCMRjj5TT0Y/JsdzEuL59h2arvoy+pGN3C4RT3Ci5xBtiZD8IzBuHFVBH/i1k0S2e/UunBcofS57Lc9lIJKjg+weyhqq2lE2hN7amjJJURKzHcDFiLH14OuROP90xBjQ=="}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:03.588709 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-71dc70b4-a230-4fd7-8dab-167d7ab4c01e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for project 7ad628e26f9349e59d73f6606242d957. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:38:03.593671 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-71dc70b4-a230-4fd7-8dab-167d7ab4c01e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for user 1f86305f296440bcae5268e1a0c8b089 and project 7ad628e26f9349e59d73f6606242d957. Resources: {'key_pairs'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:38:03.623898 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-71dc70b4-a230-4fd7-8dab-167d7ab4c01e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058447 Jul 25 16:38:03.624551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 461/957] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:38:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:05.357016 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-350226306", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efa07ab3-0bdf-47e0-83af-e1fbc262fab3"}], "security_groups": [{"name": "tempest-securitygroup--506508364"}], "key_name": "tempest-keypair-2027801037", "user_data": "}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:05.506446 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.network.neutron [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] validate_networks() for [('efa07ab3-0bdf-47e0-83af-e1fbc262fab3', None, None, None, None, None)] {{(pid=117919) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:38:05.985664 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Flavor limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:38:05.986138 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Image limits 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:38:05.986669 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Flavor pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:38:05.987129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Image pref 0:0:0 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:38:05.987593 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.virt.hardware [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117919) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:38:06.000609 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:06.001054 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:06.001921 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:06.002362 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:06.023423 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for project 7ad628e26f9349e59d73f6606242d957. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:38:06.028701 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for user 1f86305f296440bcae5268e1a0c8b089 and project 7ad628e26f9349e59d73f6606242d957. Resources: {'instances', 'cores', 'ram'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:38:06.042846 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Going to run 1 instances... {{(pid=117919) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:38:06.045298 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117919) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:38:06.114331 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-821c0f74-c763-4657-926a-680f4c5eb19f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.765279 Jul 25 16:38:06.115448 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 497/958] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:38:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:38:06.132451 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cac6f543-4ab5-42c8-ac31-5cd92778cb60 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:06.133640 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cac6f543-4ab5-42c8-ac31-5cd92778cb60 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:06.219036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cac6f543-4ab5-42c8-ac31-5cd92778cb60 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:06.228128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cac6f543-4ab5-42c8-ac31-5cd92778cb60 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1241 microversion: 2.1 time: 0.104054 Jul 25 16:38:06.229132 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 462/959] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:06 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:07.251430 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c8941166-453e-46bc-ba80-ca1a6d03b1b2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:07.252482 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c8941166-453e-46bc-ba80-ca1a6d03b1b2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:07.266976 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c8941166-453e-46bc-ba80-ca1a6d03b1b2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:07.267862 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c8941166-453e-46bc-ba80-ca1a6d03b1b2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:07.269643 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c8941166-453e-46bc-ba80-ca1a6d03b1b2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:07.270629 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c8941166-453e-46bc-ba80-ca1a6d03b1b2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:07.368033 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c8941166-453e-46bc-ba80-ca1a6d03b1b2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:07.378528 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c8941166-453e-46bc-ba80-ca1a6d03b1b2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1311 microversion: 2.1 time: 0.131624 Jul 25 16:38:07.379432 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 498/960] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:07 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:08.409860 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-93683551-7eba-4c55-9b5d-f209945c4b03 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:08.411294 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-93683551-7eba-4c55-9b5d-f209945c4b03 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:08.420553 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93683551-7eba-4c55-9b5d-f209945c4b03 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:08.421418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93683551-7eba-4c55-9b5d-f209945c4b03 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:08.422761 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93683551-7eba-4c55-9b5d-f209945c4b03 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:08.423645 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-93683551-7eba-4c55-9b5d-f209945c4b03 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:08.611035 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-93683551-7eba-4c55-9b5d-f209945c4b03 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:08.623994 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-93683551-7eba-4c55-9b5d-f209945c4b03 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1366 microversion: 2.1 time: 0.220202 Jul 25 16:38:08.625073 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 463/961] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:08 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:08.976961 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-66fb99bf-287c-462c-9bb5-682852e444f8 req-dd71f18e-f79b-4d5c-a2bf-3624cabcc33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ef9254-aaca-4f79-a9c2-7aff5836d680", "tag": "5fc2d234-a9a1-47d7-9f68-c899ab290a8f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:09.009989 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-66fb99bf-287c-462c-9bb5-682852e444f8 req-dd71f18e-f79b-4d5c-a2bf-3624cabcc33a service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.010783 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-66fb99bf-287c-462c-9bb5-682852e444f8 req-dd71f18e-f79b-4d5c-a2bf-3624cabcc33a service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:09.031872 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-66fb99bf-287c-462c-9bb5-682852e444f8 req-dd71f18e-f79b-4d5c-a2bf-3624cabcc33a service nova] Creating event network-changed:5fc2d234-a9a1-47d7-9f68-c899ab290a8f for instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 on hv-cinder-83697 Jul 25 16:38:09.041690 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-66fb99bf-287c-462c-9bb5-682852e444f8 req-dd71f18e-f79b-4d5c-a2bf-3624cabcc33a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071471 Jul 25 16:38:09.043220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 499/962] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:09.649814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-23d0caaa-019d-4a8a-981c-395677e086e0 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:09.649814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-23d0caaa-019d-4a8a-981c-395677e086e0 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:09.659520 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23d0caaa-019d-4a8a-981c-395677e086e0 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.659975 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23d0caaa-019d-4a8a-981c-395677e086e0 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:09.660780 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23d0caaa-019d-4a8a-981c-395677e086e0 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:09.661320 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-23d0caaa-019d-4a8a-981c-395677e086e0 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:09.842822 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-23d0caaa-019d-4a8a-981c-395677e086e0 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:09.851903 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-23d0caaa-019d-4a8a-981c-395677e086e0 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1366 microversion: 2.1 time: 0.208460 Jul 25 16:38:09.852836 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 464/963] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:09 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:10.881607 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-65911b14-774f-428a-bf21-7a7fd6ddb102 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:10.882886 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-65911b14-774f-428a-bf21-7a7fd6ddb102 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:10.894465 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65911b14-774f-428a-bf21-7a7fd6ddb102 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:10.895203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65911b14-774f-428a-bf21-7a7fd6ddb102 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:10.896479 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65911b14-774f-428a-bf21-7a7fd6ddb102 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:10.897251 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-65911b14-774f-428a-bf21-7a7fd6ddb102 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:11.101242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-65911b14-774f-428a-bf21-7a7fd6ddb102 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:11.113206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-65911b14-774f-428a-bf21-7a7fd6ddb102 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1366 microversion: 2.1 time: 0.240419 Jul 25 16:38:11.114138 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 500/964] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:10 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:12.136062 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-ffb9d7e6-466a-4a8f-9818-4e9a0654de63 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:12.136718 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-ffb9d7e6-466a-4a8f-9818-4e9a0654de63 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:12.144380 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffb9d7e6-466a-4a8f-9818-4e9a0654de63 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:12.144814 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffb9d7e6-466a-4a8f-9818-4e9a0654de63 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:12.145765 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffb9d7e6-466a-4a8f-9818-4e9a0654de63 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:12.146189 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-ffb9d7e6-466a-4a8f-9818-4e9a0654de63 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:12.305435 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-ffb9d7e6-466a-4a8f-9818-4e9a0654de63 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:12.314444 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-ffb9d7e6-466a-4a8f-9818-4e9a0654de63 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1366 microversion: 2.1 time: 0.182432 Jul 25 16:38:12.315413 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 465/965] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:12 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:13.339521 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9e3ea818-ea0e-4f65-a1c7-7a3e7b852cd9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:13.340306 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9e3ea818-ea0e-4f65-a1c7-7a3e7b852cd9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:13.347863 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e3ea818-ea0e-4f65-a1c7-7a3e7b852cd9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:13.348390 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e3ea818-ea0e-4f65-a1c7-7a3e7b852cd9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:13.349235 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e3ea818-ea0e-4f65-a1c7-7a3e7b852cd9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:13.349766 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9e3ea818-ea0e-4f65-a1c7-7a3e7b852cd9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:13.528094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9e3ea818-ea0e-4f65-a1c7-7a3e7b852cd9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:13.541731 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9e3ea818-ea0e-4f65-a1c7-7a3e7b852cd9 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1366 microversion: 2.1 time: 0.206555 Jul 25 16:38:13.542797 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 501/966] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:13 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:14.567001 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-33cc8f1d-9141-4957-8582-9ccb60c6240f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:14.568071 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-33cc8f1d-9141-4957-8582-9ccb60c6240f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:14.576534 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33cc8f1d-9141-4957-8582-9ccb60c6240f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:14.576989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33cc8f1d-9141-4957-8582-9ccb60c6240f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:14.577862 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33cc8f1d-9141-4957-8582-9ccb60c6240f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:14.578312 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-33cc8f1d-9141-4957-8582-9ccb60c6240f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:14.764469 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-33cc8f1d-9141-4957-8582-9ccb60c6240f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:14.774485 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-33cc8f1d-9141-4957-8582-9ccb60c6240f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1366 microversion: 2.1 time: 0.212506 Jul 25 16:38:14.775101 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 466/967] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:14 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:15.807949 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9db19eaf-f935-484e-b2d3-8cadc8564d95 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:15.808799 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9db19eaf-f935-484e-b2d3-8cadc8564d95 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:15.816292 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9db19eaf-f935-484e-b2d3-8cadc8564d95 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:15.816749 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9db19eaf-f935-484e-b2d3-8cadc8564d95 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:15.817706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9db19eaf-f935-484e-b2d3-8cadc8564d95 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:15.818122 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9db19eaf-f935-484e-b2d3-8cadc8564d95 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:15.843192 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-75e4298e-d007-4d2a-9fc7-7e662a45838f req-65c9d7b4-fc9c-42b9-acd1-0fe7a6d960cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ef9254-aaca-4f79-a9c2-7aff5836d680", "name": "network-vif-plugged", "status": "completed", "tag": "5fc2d234-a9a1-47d7-9f68-c899ab290a8f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:15.862064 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-75e4298e-d007-4d2a-9fc7-7e662a45838f req-65c9d7b4-fc9c-42b9-acd1-0fe7a6d960cd service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:15.862999 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-75e4298e-d007-4d2a-9fc7-7e662a45838f req-65c9d7b4-fc9c-42b9-acd1-0fe7a6d960cd service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:15.884086 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-75e4298e-d007-4d2a-9fc7-7e662a45838f req-65c9d7b4-fc9c-42b9-acd1-0fe7a6d960cd service nova] Creating event network-vif-plugged:5fc2d234-a9a1-47d7-9f68-c899ab290a8f for instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 on hv-cinder-83697 Jul 25 16:38:15.891323 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-75e4298e-d007-4d2a-9fc7-7e662a45838f req-65c9d7b4-fc9c-42b9-acd1-0fe7a6d960cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053989 Jul 25 16:38:15.892627 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 467/968] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:15.998598 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9db19eaf-f935-484e-b2d3-8cadc8564d95 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:16.012751 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9db19eaf-f935-484e-b2d3-8cadc8564d95 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1366 microversion: 2.1 time: 0.208343 Jul 25 16:38:16.013825 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 502/969] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:15 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:17.033741 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:17.042173 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3ac107e5-f244-4b5d-911b-069449762bc5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:17.043472 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3ac107e5-f244-4b5d-911b-069449762bc5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:17.054248 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ac107e5-f244-4b5d-911b-069449762bc5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:17.055555 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ac107e5-f244-4b5d-911b-069449762bc5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:17.056558 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ac107e5-f244-4b5d-911b-069449762bc5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:17.057176 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3ac107e5-f244-4b5d-911b-069449762bc5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:17.241464 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3ac107e5-f244-4b5d-911b-069449762bc5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:17.250403 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3ac107e5-f244-4b5d-911b-069449762bc5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1366 microversion: 2.1 time: 0.218064 Jul 25 16:38:17.251032 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 468/970] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:17 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:18.273661 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-33c99c1f-ed6f-48ac-8ac8-5b0f20787791 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:18.274319 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-33c99c1f-ed6f-48ac-8ac8-5b0f20787791 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:18.276736 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:18.277560 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:18.285291 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-33c99c1f-ed6f-48ac-8ac8-5b0f20787791 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:18.286003 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-33c99c1f-ed6f-48ac-8ac8-5b0f20787791 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:18.286834 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-33c99c1f-ed6f-48ac-8ac8-5b0f20787791 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:18.287274 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-33c99c1f-ed6f-48ac-8ac8-5b0f20787791 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:18.452056 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-33c99c1f-ed6f-48ac-8ac8-5b0f20787791 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:38:18.461280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-33c99c1f-ed6f-48ac-8ac8-5b0f20787791 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1555 microversion: 2.1 time: 0.191807 Jul 25 16:38:18.462115 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 503/971] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:38:18 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:38:18.488187 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e88e2df8-437f-4fef-8649-2c3706363672 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:18.489128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e88e2df8-437f-4fef-8649-2c3706363672 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:18.497051 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e88e2df8-437f-4fef-8649-2c3706363672 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:18.497647 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e88e2df8-437f-4fef-8649-2c3706363672 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:18.498473 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e88e2df8-437f-4fef-8649-2c3706363672 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:18.498911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e88e2df8-437f-4fef-8649-2c3706363672 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:18.611175 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e88e2df8-437f-4fef-8649-2c3706363672 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128012 Jul 25 16:38:18.611857 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 469/972] 10.222.0.66 () {58 vars in 1275 bytes} [Mon Jul 25 16:38:18 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:38:19.965039 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [req-c3e5a280-bd1e-4528-973e-72e1236ac419 req-10f84562-efbd-49d6-953d-c19e12391481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ef9254-aaca-4f79-a9c2-7aff5836d680", "tag": "5fc2d234-a9a1-47d7-9f68-c899ab290a8f"}]} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:19.977764 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c3e5a280-bd1e-4528-973e-72e1236ac419 req-10f84562-efbd-49d6-953d-c19e12391481 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:19.978439 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [req-c3e5a280-bd1e-4528-973e-72e1236ac419 req-10f84562-efbd-49d6-953d-c19e12391481 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:19.992799 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.compute.server_external_events [req-c3e5a280-bd1e-4528-973e-72e1236ac419 req-10f84562-efbd-49d6-953d-c19e12391481 service nova] Creating event network-changed:5fc2d234-a9a1-47d7-9f68-c899ab290a8f for instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 on hv-cinder-83697 Jul 25 16:38:20.000086 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [req-c3e5a280-bd1e-4528-973e-72e1236ac419 req-10f84562-efbd-49d6-953d-c19e12391481 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039249 Jul 25 16:38:20.001104 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 504/973] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:38:53.418255 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:53.419308 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=42 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:53.425767 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-5e5e9185-fb3f-4a9e-a615-6ecda71e8b9f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:38:53.426511 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-5e5e9185-fb3f-4a9e-a615-6ecda71e8b9f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:53.436425 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e5e9185-fb3f-4a9e-a615-6ecda71e8b9f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:53.436949 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e5e9185-fb3f-4a9e-a615-6ecda71e8b9f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:53.437998 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e5e9185-fb3f-4a9e-a615-6ecda71e8b9f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:53.438513 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-5e5e9185-fb3f-4a9e-a615-6ecda71e8b9f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:53.484976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-5e5e9185-fb3f-4a9e-a615-6ecda71e8b9f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/ips" status: 200 len: 148 microversion: 2.1 time: 0.067828 Jul 25 16:38:53.486128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 470/974] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:38:53 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/ips => generated 148 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:38:54.923661 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:54.924648 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=37 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:38:54.930976 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-ebc06d8b-eee8-42aa-aca6-759804f4f117 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86e94dc8-daee-403e-be56-e31b57634a6b"}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:38:54.934176 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-ebc06d8b-eee8-42aa-aca6-759804f4f117 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:38:54.944747 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ebc06d8b-eee8-42aa-aca6-759804f4f117 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:54.945245 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ebc06d8b-eee8-42aa-aca6-759804f4f117 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:54.946109 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ebc06d8b-eee8-42aa-aca6-759804f4f117 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:38:54.946581 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-ebc06d8b-eee8-42aa-aca6-759804f4f117 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:38:55.266328 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-ebc06d8b-eee8-42aa-aca6-759804f4f117 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343725 Jul 25 16:38:55.267307 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 505/975] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:38:54 2022] POST /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:01.836404 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86e94dc8-daee-403e-be56-e31b57634a6b"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:01.840510 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:01.852762 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:01.853531 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:01.854842 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:01.855549 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:01.992337 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Invalid volume: volume 86e94dc8-daee-403e-be56-e31b57634a6b is already attached to instances: 23ef9254-aaca-4f79-a9c2-7aff5836d680 Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments HTTP/1.1 Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 74 Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:39:01.994685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {"volumeAttachment": {"volumeId": "86e94dc8-daee-403e-be56-e31b57634a6b"}} Jul 25 16:39:01.997163 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Invalid volume: volume 86e94dc8-daee-403e-be56-e31b57634a6b is already attached to instances: 23ef9254-aaca-4f79-a9c2-7aff5836d680 Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'server_id': '23ef9254-aaca-4f79-a9c2-7aff5836d680', 'body': {'volumeAttachment': {'volumeId': '86e94dc8-daee-403e-be56-e31b57634a6b'}}} Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 86e94dc8-daee-403e-be56-e31b57634a6b is already attached to instances: 23ef9254-aaca-4f79-a9c2-7aff5836d680 Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:39:01.998821 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 86e94dc8-daee-403e-be56-e31b57634a6b is already attached to instances: 23ef9254-aaca-4f79-a9c2-7aff5836d680 Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:02.001034 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:02.003587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:02.003587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:02.003587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:02.003587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 86e94dc8-daee-403e-be56-e31b57634a6b is already attached to instances: 23ef9254-aaca-4f79-a9c2-7aff5836d680 Jul 25 16:39:02.003587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:39:02.003587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 400 to user: Invalid volume: volume 86e94dc8-daee-403e-be56-e31b57634a6b is already attached to instances: 23ef9254-aaca-4f79-a9c2-7aff5836d680 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:02.003587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e8a03ef6-43e2-4009-ac78-2f0c9795fea1 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.167689 Jul 25 16:39:02.003587 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 471/976] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:39:01 2022] POST /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments => generated 174 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:39:02.073489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e5f951af-83fc-4605-b318-7fa3a1f201a5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:02.074414 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e5f951af-83fc-4605-b318-7fa3a1f201a5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:02.081268 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5f951af-83fc-4605-b318-7fa3a1f201a5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:02.081864 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5f951af-83fc-4605-b318-7fa3a1f201a5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:02.082707 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5f951af-83fc-4605-b318-7fa3a1f201a5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:02.083325 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-e5f951af-83fc-4605-b318-7fa3a1f201a5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:02.186273 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-e5f951af-83fc-4605-b318-7fa3a1f201a5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lazy-loading 'services' on Instance uuid 23ef9254-aaca-4f79-a9c2-7aff5836d680 {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:39:02.286068 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e5f951af-83fc-4605-b318-7fa3a1f201a5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments/86e94dc8-daee-403e-be56-e31b57634a6b" status: 202 len: 0 microversion: 2.1 time: 0.217367 Jul 25 16:39:02.286980 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 506/977] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:39:02 2022] DELETE /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments/86e94dc8-daee-403e-be56-e31b57634a6b => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:39:02.296968 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-6f0f4676-4789-4464-8d74-03827f6f4ca4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:02.300148 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-6f0f4676-4789-4464-8d74-03827f6f4ca4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:02.312901 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f0f4676-4789-4464-8d74-03827f6f4ca4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:02.313570 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f0f4676-4789-4464-8d74-03827f6f4ca4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:02.314965 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f0f4676-4789-4464-8d74-03827f6f4ca4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:02.315661 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-6f0f4676-4789-4464-8d74-03827f6f4ca4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:02.359254 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-6f0f4676-4789-4464-8d74-03827f6f4ca4 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066284 Jul 25 16:39:02.360225 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 472/978] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:39:02 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:03.374746 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-de0dd012-b30a-490c-9675-46c52d16ef05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:03.377391 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-de0dd012-b30a-490c-9675-46c52d16ef05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:03.386292 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de0dd012-b30a-490c-9675-46c52d16ef05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:03.386752 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de0dd012-b30a-490c-9675-46c52d16ef05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:03.387586 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de0dd012-b30a-490c-9675-46c52d16ef05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:03.388164 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-de0dd012-b30a-490c-9675-46c52d16ef05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:03.428226 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-de0dd012-b30a-490c-9675-46c52d16ef05 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058199 Jul 25 16:39:03.429280 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 507/979] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:39:03 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:39:03.499905 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d144094d-13d5-4bf4-b93b-f50fade370f3 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:03.500556 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d144094d-13d5-4bf4-b93b-f50fade370f3 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:03.509561 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d144094d-13d5-4bf4-b93b-f50fade370f3 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:03.510011 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d144094d-13d5-4bf4-b93b-f50fade370f3 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:03.510811 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d144094d-13d5-4bf4-b93b-f50fade370f3 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:03.511274 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d144094d-13d5-4bf4-b93b-f50fade370f3 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:03.546109 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d144094d-13d5-4bf4-b93b-f50fade370f3 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:39:03.683930 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d144094d-13d5-4bf4-b93b-f50fade370f3 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 204 len: 0 microversion: 2.1 time: 0.187531 Jul 25 16:39:03.684800 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 473/980] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:39:03 2022] DELETE /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 16:39:03.696393 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d5644791-0666-4694-a15b-c90823577c8c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:03.697041 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d5644791-0666-4694-a15b-c90823577c8c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:03.704763 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5644791-0666-4694-a15b-c90823577c8c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:03.705292 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5644791-0666-4694-a15b-c90823577c8c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:03.706232 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5644791-0666-4694-a15b-c90823577c8c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:03.706723 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d5644791-0666-4694-a15b-c90823577c8c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:03.870503 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-d5644791-0666-4694-a15b-c90823577c8c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:03.888287 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d5644791-0666-4694-a15b-c90823577c8c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1679 microversion: 2.1 time: 0.196285 Jul 25 16:39:03.889323 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 508/981] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:03 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:39:04.913554 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-533fe41d-05c5-4a3d-99e4-098b00b04ca7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:04.914385 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-533fe41d-05c5-4a3d-99e4-098b00b04ca7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:04.921546 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-533fe41d-05c5-4a3d-99e4-098b00b04ca7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:04.922059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-533fe41d-05c5-4a3d-99e4-098b00b04ca7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:04.922877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-533fe41d-05c5-4a3d-99e4-098b00b04ca7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:04.923377 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-533fe41d-05c5-4a3d-99e4-098b00b04ca7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:05.094216 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-533fe41d-05c5-4a3d-99e4-098b00b04ca7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:05.108073 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-533fe41d-05c5-4a3d-99e4-098b00b04ca7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1679 microversion: 2.1 time: 0.198997 Jul 25 16:39:05.109404 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 474/982] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:04 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:06.144657 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-79a5485f-1675-41c0-a2fd-e40477cb84b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:06.145698 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-79a5485f-1675-41c0-a2fd-e40477cb84b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:06.160541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-79a5485f-1675-41c0-a2fd-e40477cb84b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:06.161301 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-79a5485f-1675-41c0-a2fd-e40477cb84b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:06.162211 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-79a5485f-1675-41c0-a2fd-e40477cb84b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:06.162751 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-79a5485f-1675-41c0-a2fd-e40477cb84b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:06.244199 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-79a5485f-1675-41c0-a2fd-e40477cb84b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:06.256759 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-79a5485f-1675-41c0-a2fd-e40477cb84b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 200 len: 1612 microversion: 2.1 time: 0.116485 Jul 25 16:39:06.257854 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 509/983] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:06 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 1612 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:06.595487 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-22960e3d-29d9-4cd5-adda-f48d1c49b498 req-0557d52a-9b3c-40f8-a462-b89d166eac05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ef9254-aaca-4f79-a9c2-7aff5836d680", "name": "network-vif-deleted", "tag": "5fc2d234-a9a1-47d7-9f68-c899ab290a8f"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:06.613595 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-22960e3d-29d9-4cd5-adda-f48d1c49b498 req-0557d52a-9b3c-40f8-a462-b89d166eac05 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:06.614197 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-22960e3d-29d9-4cd5-adda-f48d1c49b498 req-0557d52a-9b3c-40f8-a462-b89d166eac05 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:06.631957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-22960e3d-29d9-4cd5-adda-f48d1c49b498 req-0557d52a-9b3c-40f8-a462-b89d166eac05 service nova] Creating event network-vif-deleted:5fc2d234-a9a1-47d7-9f68-c899ab290a8f for instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 on hv-cinder-83697 Jul 25 16:39:06.642736 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-22960e3d-29d9-4cd5-adda-f48d1c49b498 req-0557d52a-9b3c-40f8-a462-b89d166eac05 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050056 Jul 25 16:39:06.644269 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 475/984] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:07.286745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:07.288520 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:07.296462 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:07.297072 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:07.298195 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:07.299024 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:07.319188 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 HTTP/1.1 Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:39:07.321868 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:39:07.325170 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '23ef9254-aaca-4f79-a9c2-7aff5836d680'} Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:39:07.326340 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:39:07.330094 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:39:07.333359 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:39:07.333359 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-62efe3ef-081c-45d7-88f6-92747fecd5af tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 404 len: 111 microversion: 2.1 time: 0.044172 Jul 25 16:39:07.333359 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 510/985] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:07 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:39:07.335733 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-33375262-7b9f-4287-ba74-63607bf1c287 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '.version_select at 0x7f44100580d0>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:07.360911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-33375262-7b9f-4287-ba74-63607bf1c287 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027801037" status: 202 len: 0 microversion: 2.1 time: 0.029588 Jul 25 16:39:07.361685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 476/986] 10.222.0.66 () {58 vars in 1221 bytes} [Mon Jul 25 16:39:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027801037 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:39:08.225262 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fb99120a-6b6e-434a-986d-64eef39a7f3e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: .version_select at 0x7f440a5be040>, body: {"keypair": {"name": "tempest-keypair-733179447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaHnmSCO+wYz46PydLxeSAKnNNjjBPlMogl1GWM1HcJh5ciffsA7rhSK3ULtHfqdb0W+9Jj5W7LkQ7Du3OXnF9mL1Dbpkivy/PrtiabRlPL0ED9C+Dg62mLS+WRr9XKlQ=="}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:08.253210 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-fb99120a-6b6e-434a-986d-64eef39a7f3e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for project 7ad628e26f9349e59d73f6606242d957. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:39:08.260231 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.quota [None req-fb99120a-6b6e-434a-986d-64eef39a7f3e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for user 1f86305f296440bcae5268e1a0c8b089 and project 7ad628e26f9349e59d73f6606242d957. Resources: {'key_pairs'} {{(pid=117919) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:39:08.304541 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fb99120a-6b6e-434a-986d-64eef39a7f3e tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087085 Jul 25 16:39:08.305572 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 511/987] 10.222.0.66 () {60 vars in 1159 bytes} [Mon Jul 25 16:39:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:09.897570 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-30629174", "imageRef": "ac2c370a-f3b8-4a73-adcb-4eebb715e5eb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efa07ab3-0bdf-47e0-83af-e1fbc262fab3"}], "security_groups": [{"name": "tempest-securitygroup--1691926598"}], "key_name": "tempest-keypair-733179447", "user_data": "}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:10.038160 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.network.neutron [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] validate_networks() for [('efa07ab3-0bdf-47e0-83af-e1fbc262fab3', None, None, None, None, None)] {{(pid=117920) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 16:39:10.564978 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Flavor limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 16:39:10.565676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Image limits 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 16:39:10.566153 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Flavor pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 16:39:10.566561 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Image pref 0:0:0 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 16:39:10.566963 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.virt.hardware [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117920) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 16:39:10.577187 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.577661 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.578477 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:10.578911 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:10.597973 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for project 7ad628e26f9349e59d73f6606242d957. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 16:39:10.603192 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.quota [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Getting quotas for user 1f86305f296440bcae5268e1a0c8b089 and project 7ad628e26f9349e59d73f6606242d957. Resources: {'instances', 'cores', 'ram'} {{(pid=117920) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 16:39:10.616840 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Going to run 1 instances... {{(pid=117920) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 16:39:10.619374 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac2c370a-f3b8-4a73-adcb-4eebb715e5eb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117920) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 16:39:10.672412 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-a953e8cc-3c7a-4fcd-91d1-3d9d41aadbbb tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.784395 Jul 25 16:39:10.673422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 477/988] 10.222.0.66 () {60 vars in 1147 bytes} [Mon Jul 25 16:39:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 16:39:10.689557 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-e4c7b830-2cfa-4552-94dd-536aaf0d1033 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:10.690998 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-e4c7b830-2cfa-4552-94dd-536aaf0d1033 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:10.773804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-e4c7b830-2cfa-4552-94dd-536aaf0d1033 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:10.782271 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-e4c7b830-2cfa-4552-94dd-536aaf0d1033 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1239 microversion: 2.1 time: 0.097187 Jul 25 16:39:10.783426 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 512/989] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:10 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 16:39:11.812327 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb4311f2-6527-439b-a9a5-f726add027b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:11.816093 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb4311f2-6527-439b-a9a5-f726add027b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:11.826244 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb4311f2-6527-439b-a9a5-f726add027b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:11.826940 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb4311f2-6527-439b-a9a5-f726add027b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:11.827861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb4311f2-6527-439b-a9a5-f726add027b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:11.828539 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb4311f2-6527-439b-a9a5-f726add027b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:12.275289 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb4311f2-6527-439b-a9a5-f726add027b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:12.290685 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb4311f2-6527-439b-a9a5-f726add027b7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1299 microversion: 2.1 time: 0.486915 Jul 25 16:39:12.291830 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 478/990] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:11 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1299 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:13.329662 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-0b9558c7-0d9f-4d6f-92a8-8bacb385561d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:13.330751 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-0b9558c7-0d9f-4d6f-92a8-8bacb385561d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:13.338983 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b9558c7-0d9f-4d6f-92a8-8bacb385561d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:13.339449 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b9558c7-0d9f-4d6f-92a8-8bacb385561d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:13.340269 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b9558c7-0d9f-4d6f-92a8-8bacb385561d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:13.340718 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-0b9558c7-0d9f-4d6f-92a8-8bacb385561d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:13.543969 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-0b9558c7-0d9f-4d6f-92a8-8bacb385561d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:13.558177 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-0b9558c7-0d9f-4d6f-92a8-8bacb385561d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1365 microversion: 2.1 time: 0.235768 Jul 25 16:39:13.559554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 513/991] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:13 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:13.768534 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-fc9017a7-10a0-46b1-95f9-831f2c6a5d81 req-b79677c2-c65d-4228-ad61-484c062e1760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0fffa70-0205-49e4-88c9-16be4175677e", "tag": "ec86d707-0c49-40e5-a0d6-9d1aafc55055"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:13.786791 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fc9017a7-10a0-46b1-95f9-831f2c6a5d81 req-b79677c2-c65d-4228-ad61-484c062e1760 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:13.787263 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-fc9017a7-10a0-46b1-95f9-831f2c6a5d81 req-b79677c2-c65d-4228-ad61-484c062e1760 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:13.805026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-fc9017a7-10a0-46b1-95f9-831f2c6a5d81 req-b79677c2-c65d-4228-ad61-484c062e1760 service nova] Creating event network-changed:ec86d707-0c49-40e5-a0d6-9d1aafc55055 for instance e0fffa70-0205-49e4-88c9-16be4175677e on hv-cinder-83697 Jul 25 16:39:13.811725 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-fc9017a7-10a0-46b1-95f9-831f2c6a5d81 req-b79677c2-c65d-4228-ad61-484c062e1760 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048151 Jul 25 16:39:13.812354 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 479/992] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:14.589124 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-776d27b9-bf0d-4ea5-8b1d-ba2c95d579bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:14.590000 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-776d27b9-bf0d-4ea5-8b1d-ba2c95d579bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:14.598381 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-776d27b9-bf0d-4ea5-8b1d-ba2c95d579bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:14.598887 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-776d27b9-bf0d-4ea5-8b1d-ba2c95d579bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:14.599774 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-776d27b9-bf0d-4ea5-8b1d-ba2c95d579bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:14.600325 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-776d27b9-bf0d-4ea5-8b1d-ba2c95d579bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:14.768506 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-776d27b9-bf0d-4ea5-8b1d-ba2c95d579bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:14.782413 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-776d27b9-bf0d-4ea5-8b1d-ba2c95d579bf tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1365 microversion: 2.1 time: 0.197231 Jul 25 16:39:14.783448 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 514/993] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:14 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:15.808955 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-293ee2bd-3417-4940-9e1e-0f09071560e7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:15.809676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-293ee2bd-3417-4940-9e1e-0f09071560e7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:15.816820 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-293ee2bd-3417-4940-9e1e-0f09071560e7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:15.817269 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-293ee2bd-3417-4940-9e1e-0f09071560e7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:15.818134 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-293ee2bd-3417-4940-9e1e-0f09071560e7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:15.818551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-293ee2bd-3417-4940-9e1e-0f09071560e7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:15.975094 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-293ee2bd-3417-4940-9e1e-0f09071560e7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:15.984202 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-293ee2bd-3417-4940-9e1e-0f09071560e7 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1365 microversion: 2.1 time: 0.180344 Jul 25 16:39:15.985038 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 480/994] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:15 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:17.006951 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-62e77d32-81d7-4602-ac07-d48925b70520 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:17.007839 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-62e77d32-81d7-4602-ac07-d48925b70520 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:17.016888 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62e77d32-81d7-4602-ac07-d48925b70520 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:17.017393 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62e77d32-81d7-4602-ac07-d48925b70520 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:17.018331 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62e77d32-81d7-4602-ac07-d48925b70520 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:17.019003 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-62e77d32-81d7-4602-ac07-d48925b70520 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:17.193851 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-62e77d32-81d7-4602-ac07-d48925b70520 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:17.206052 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-62e77d32-81d7-4602-ac07-d48925b70520 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1365 microversion: 2.1 time: 0.202679 Jul 25 16:39:17.207114 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 515/995] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:17 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:18.229030 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3daaa50f-de34-407d-91d0-be90f37dd544 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:18.229811 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3daaa50f-de34-407d-91d0-be90f37dd544 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:18.237592 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3daaa50f-de34-407d-91d0-be90f37dd544 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:18.238002 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3daaa50f-de34-407d-91d0-be90f37dd544 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:18.238896 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3daaa50f-de34-407d-91d0-be90f37dd544 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:18.239388 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3daaa50f-de34-407d-91d0-be90f37dd544 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:18.412495 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-3daaa50f-de34-407d-91d0-be90f37dd544 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:18.428596 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3daaa50f-de34-407d-91d0-be90f37dd544 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1365 microversion: 2.1 time: 0.203251 Jul 25 16:39:18.430105 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 481/996] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:18 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:19.462742 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-b6bbffe7-6c51-4e8c-9ca4-f189410599d2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:19.463807 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-b6bbffe7-6c51-4e8c-9ca4-f189410599d2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:19.473554 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6bbffe7-6c51-4e8c-9ca4-f189410599d2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:19.474284 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6bbffe7-6c51-4e8c-9ca4-f189410599d2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:19.475526 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6bbffe7-6c51-4e8c-9ca4-f189410599d2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:19.476258 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-b6bbffe7-6c51-4e8c-9ca4-f189410599d2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:19.640271 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-b6bbffe7-6c51-4e8c-9ca4-f189410599d2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:19.650655 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-b6bbffe7-6c51-4e8c-9ca4-f189410599d2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1365 microversion: 2.1 time: 0.192356 Jul 25 16:39:19.651252 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 516/997] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:19 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:20.184572 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-c2dbc68d-f4a1-4713-8a0c-68b2f40efb11 req-947dd1c4-bc16-49cf-9bf6-58e0cb634e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fffa70-0205-49e4-88c9-16be4175677e", "name": "network-vif-plugged", "status": "completed", "tag": "ec86d707-0c49-40e5-a0d6-9d1aafc55055"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:20.202676 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c2dbc68d-f4a1-4713-8a0c-68b2f40efb11 req-947dd1c4-bc16-49cf-9bf6-58e0cb634e13 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:20.203341 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-c2dbc68d-f4a1-4713-8a0c-68b2f40efb11 req-947dd1c4-bc16-49cf-9bf6-58e0cb634e13 service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:20.220466 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-c2dbc68d-f4a1-4713-8a0c-68b2f40efb11 req-947dd1c4-bc16-49cf-9bf6-58e0cb634e13 service nova] Creating event network-vif-plugged:ec86d707-0c49-40e5-a0d6-9d1aafc55055 for instance e0fffa70-0205-49e4-88c9-16be4175677e on hv-cinder-83697 Jul 25 16:39:20.227159 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-c2dbc68d-f4a1-4713-8a0c-68b2f40efb11 req-947dd1c4-bc16-49cf-9bf6-58e0cb634e13 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047557 Jul 25 16:39:20.228287 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 482/998] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:20.688216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-85380dde-b9b6-4290-9fe6-4dc344679e31 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:20.689102 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-85380dde-b9b6-4290-9fe6-4dc344679e31 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:20.698239 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85380dde-b9b6-4290-9fe6-4dc344679e31 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:20.698938 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85380dde-b9b6-4290-9fe6-4dc344679e31 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:20.699806 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85380dde-b9b6-4290-9fe6-4dc344679e31 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:20.700242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-85380dde-b9b6-4290-9fe6-4dc344679e31 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:20.778896 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell0:SELECT=6 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:20.866973 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-85380dde-b9b6-4290-9fe6-4dc344679e31 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:20.875608 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-85380dde-b9b6-4290-9fe6-4dc344679e31 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1365 microversion: 2.1 time: 0.192230 Jul 25 16:39:20.876573 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 517/999] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:20 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:21.907381 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=2 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:21.908265 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell0:SELECT=6 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:21.913554 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cc22daab-736f-40d3-ac18-83f07cd3bd56 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:21.914322 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cc22daab-736f-40d3-ac18-83f07cd3bd56 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:21.923123 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc22daab-736f-40d3-ac18-83f07cd3bd56 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:21.923621 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc22daab-736f-40d3-ac18-83f07cd3bd56 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:21.924629 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc22daab-736f-40d3-ac18-83f07cd3bd56 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:21.925109 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cc22daab-736f-40d3-ac18-83f07cd3bd56 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:22.110956 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cc22daab-736f-40d3-ac18-83f07cd3bd56 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:39:22.123693 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cc22daab-736f-40d3-ac18-83f07cd3bd56 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1555 microversion: 2.1 time: 0.217755 Jul 25 16:39:22.124580 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 483/1000] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:39:21 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:39:22.157659 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-d1c49796-0760-4aa6-b965-035e0bc9c3de tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:22.158667 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-d1c49796-0760-4aa6-b965-035e0bc9c3de tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:22.166880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1c49796-0760-4aa6-b965-035e0bc9c3de tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:22.167331 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1c49796-0760-4aa6-b965-035e0bc9c3de tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:22.168133 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1c49796-0760-4aa6-b965-035e0bc9c3de tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:22.168632 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-d1c49796-0760-4aa6-b965-035e0bc9c3de tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:22.258481 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d1c49796-0760-4aa6-b965-035e0bc9c3de tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105711 Jul 25 16:39:22.259218 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 518/1001] 10.222.0.66 () {58 vars in 1275 bytes} [Mon Jul 25 16:39:22 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:23.730467 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-36f1688c-dd65-4f72-9c01-b493f0de36f5 req-19b3484d-295c-41dd-9057-bf73aa7b17ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0fffa70-0205-49e4-88c9-16be4175677e", "tag": "ec86d707-0c49-40e5-a0d6-9d1aafc55055"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:23.737215 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:23.745461 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-36f1688c-dd65-4f72-9c01-b493f0de36f5 req-19b3484d-295c-41dd-9057-bf73aa7b17ad service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:23.746087 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-36f1688c-dd65-4f72-9c01-b493f0de36f5 req-19b3484d-295c-41dd-9057-bf73aa7b17ad service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:23.752406 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG dbcounter [-] [117920] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:23.762798 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-36f1688c-dd65-4f72-9c01-b493f0de36f5 req-19b3484d-295c-41dd-9057-bf73aa7b17ad service nova] Creating event network-changed:ec86d707-0c49-40e5-a0d6-9d1aafc55055 for instance e0fffa70-0205-49e4-88c9-16be4175677e on hv-cinder-83697 Jul 25 16:39:23.769129 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-36f1688c-dd65-4f72-9c01-b493f0de36f5 req-19b3484d-295c-41dd-9057-bf73aa7b17ad service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042419 Jul 25 16:39:23.770156 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 484/1002] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:57.967303 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:57.969405 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG dbcounter [-] [117919] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 16:39:57.976808 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-577a14c3-e636-4a33-aec3-ecc8d09d5bf2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:39:57.977419 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-577a14c3-e636-4a33-aec3-ecc8d09d5bf2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:57.989117 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-577a14c3-e636-4a33-aec3-ecc8d09d5bf2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:57.989605 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-577a14c3-e636-4a33-aec3-ecc8d09d5bf2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:57.990436 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-577a14c3-e636-4a33-aec3-ecc8d09d5bf2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:57.990880 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-577a14c3-e636-4a33-aec3-ecc8d09d5bf2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:58.020025 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-577a14c3-e636-4a33-aec3-ecc8d09d5bf2 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/ips" status: 200 len: 150 microversion: 2.1 time: 0.055720 Jul 25 16:39:58.020748 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 519/1003] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:39:57 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:39:59.582019 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3e13a506-ed88-4461-ac58-5e374cf97aae tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "860f9186-f056-413e-8a13-80d5184b90fa"}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:39:59.584619 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-3e13a506-ed88-4461-ac58-5e374cf97aae tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:39:59.593522 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e13a506-ed88-4461-ac58-5e374cf97aae tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:59.593955 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e13a506-ed88-4461-ac58-5e374cf97aae tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:39:59.594843 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e13a506-ed88-4461-ac58-5e374cf97aae tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:39:59.595274 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-3e13a506-ed88-4461-ac58-5e374cf97aae tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:00.224584 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3e13a506-ed88-4461-ac58-5e374cf97aae tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "POST /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.648548 Jul 25 16:40:00.225532 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 485/1004] 10.222.0.66 () {60 vars in 1323 bytes} [Mon Jul 25 16:39:59 2022] POST /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:40:07.247028 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5661b3bb-2a20-4f96-885c-edb071884431 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:07.247949 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5661b3bb-2a20-4f96-885c-edb071884431 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:07.260925 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5661b3bb-2a20-4f96-885c-edb071884431 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:07.261722 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5661b3bb-2a20-4f96-885c-edb071884431 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:07.263220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5661b3bb-2a20-4f96-885c-edb071884431 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:07.263996 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5661b3bb-2a20-4f96-885c-edb071884431 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:07.535659 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.objects.instance [None req-5661b3bb-2a20-4f96-885c-edb071884431 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lazy-loading 'services' on Instance uuid e0fffa70-0205-49e4-88c9-16be4175677e {{(pid=117919) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 16:40:07.680757 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5661b3bb-2a20-4f96-885c-edb071884431 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-volume_attachments/860f9186-f056-413e-8a13-80d5184b90fa" status: 202 len: 0 microversion: 2.1 time: 0.440933 Jul 25 16:40:07.681890 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 520/1005] 10.222.0.66 () {58 vars in 1416 bytes} [Mon Jul 25 16:40:07 2022] DELETE /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-volume_attachments/860f9186-f056-413e-8a13-80d5184b90fa => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:40:07.698647 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-e59beab1-2c3c-44f3-9084-6dd792977a87 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:07.702915 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-e59beab1-2c3c-44f3-9084-6dd792977a87 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:07.715774 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e59beab1-2c3c-44f3-9084-6dd792977a87 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:07.716571 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e59beab1-2c3c-44f3-9084-6dd792977a87 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:07.718072 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e59beab1-2c3c-44f3-9084-6dd792977a87 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:07.718831 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-e59beab1-2c3c-44f3-9084-6dd792977a87 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:07.775766 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-e59beab1-2c3c-44f3-9084-6dd792977a87 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086450 Jul 25 16:40:07.776744 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 486/1006] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:40:07 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 16:40:08.795816 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-99cce3b7-45b5-4b93-a022-338e95e2ab1d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:08.800158 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-99cce3b7-45b5-4b93-a022-338e95e2ab1d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:08.811529 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99cce3b7-45b5-4b93-a022-338e95e2ab1d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:08.812302 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99cce3b7-45b5-4b93-a022-338e95e2ab1d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:08.813922 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99cce3b7-45b5-4b93-a022-338e95e2ab1d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:08.814706 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-99cce3b7-45b5-4b93-a022-338e95e2ab1d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:08.881736 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-99cce3b7-45b5-4b93-a022-338e95e2ab1d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094282 Jul 25 16:40:08.882817 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 521/1007] 10.222.0.66 () {58 vars in 1302 bytes} [Mon Jul 25 16:40:08 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 16:40:08.992185 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fb165bc5-d181-4cb9-91d9-1d0deedcdbcc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:08.993067 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fb165bc5-d181-4cb9-91d9-1d0deedcdbcc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:09.005639 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb165bc5-d181-4cb9-91d9-1d0deedcdbcc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:09.006420 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb165bc5-d181-4cb9-91d9-1d0deedcdbcc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:09.007785 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb165bc5-d181-4cb9-91d9-1d0deedcdbcc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:09.008489 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fb165bc5-d181-4cb9-91d9-1d0deedcdbcc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:09.063342 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fb165bc5-d181-4cb9-91d9-1d0deedcdbcc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Going to try to terminate instance {{(pid=117920) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 16:40:09.211804 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fb165bc5-d181-4cb9-91d9-1d0deedcdbcc tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 204 len: 0 microversion: 2.1 time: 0.226828 Jul 25 16:40:09.212373 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 487/1008] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:40:08 2022] DELETE /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 16:40:09.226305 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c720d157-1969-446d-8913-ba16b81ae594 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:09.227396 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c720d157-1969-446d-8913-ba16b81ae594 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:09.238671 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c720d157-1969-446d-8913-ba16b81ae594 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:09.239414 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c720d157-1969-446d-8913-ba16b81ae594 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:09.240795 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c720d157-1969-446d-8913-ba16b81ae594 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:09.241562 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c720d157-1969-446d-8913-ba16b81ae594 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:09.489743 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-c720d157-1969-446d-8913-ba16b81ae594 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:09.505383 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c720d157-1969-446d-8913-ba16b81ae594 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1680 microversion: 2.1 time: 0.286097 Jul 25 16:40:09.506321 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 522/1009] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:40:09 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1680 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:10.547612 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-cb60ede6-37f6-42b4-bbae-ae815f1a0865 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:10.548544 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-cb60ede6-37f6-42b4-bbae-ae815f1a0865 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:10.557649 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb60ede6-37f6-42b4-bbae-ae815f1a0865 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:10.558800 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb60ede6-37f6-42b4-bbae-ae815f1a0865 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:10.560170 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb60ede6-37f6-42b4-bbae-ae815f1a0865 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:10.560813 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-cb60ede6-37f6-42b4-bbae-ae815f1a0865 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:10.788612 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.policy [None req-cb60ede6-37f6-42b4-bbae-ae815f1a0865 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117920) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:10.805870 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-cb60ede6-37f6-42b4-bbae-ae815f1a0865 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1680 microversion: 2.1 time: 0.263739 Jul 25 16:40:10.807838 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 488/1010] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:40:10 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1680 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:11.849870 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-9d76eddc-9d09-4338-aac5-a591761f650b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:11.850793 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-9d76eddc-9d09-4338-aac5-a591761f650b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:11.863255 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d76eddc-9d09-4338-aac5-a591761f650b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:11.864309 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d76eddc-9d09-4338-aac5-a591761f650b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:11.865738 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d76eddc-9d09-4338-aac5-a591761f650b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:11.867509 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-9d76eddc-9d09-4338-aac5-a591761f650b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:11.975795 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.policy [None req-9d76eddc-9d09-4338-aac5-a591761f650b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f86305f296440bcae5268e1a0c8b089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad628e26f9349e59d73f6606242d957', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117919) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 16:40:11.991311 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-9d76eddc-9d09-4338-aac5-a591761f650b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 200 len: 1612 microversion: 2.1 time: 0.148889 Jul 25 16:40:11.992442 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 523/1011] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:40:11 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 1612 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 16:40:12.238669 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [req-13c1d6f3-0d88-4ac8-ad01-6c1e9db9e504 req-f0dd697d-3371-43cf-bc82-64dba53b0f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0fffa70-0205-49e4-88c9-16be4175677e", "name": "network-vif-deleted", "tag": "ec86d707-0c49-40e5-a0d6-9d1aafc55055"}]} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:12.264683 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-13c1d6f3-0d88-4ac8-ad01-6c1e9db9e504 req-f0dd697d-3371-43cf-bc82-64dba53b0f1a service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:12.272551 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [req-13c1d6f3-0d88-4ac8-ad01-6c1e9db9e504 req-f0dd697d-3371-43cf-bc82-64dba53b0f1a service nova] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:12.297536 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.compute.server_external_events [req-13c1d6f3-0d88-4ac8-ad01-6c1e9db9e504 req-f0dd697d-3371-43cf-bc82-64dba53b0f1a service nova] Creating event network-vif-deleted:ec86d707-0c49-40e5-a0d6-9d1aafc55055 for instance e0fffa70-0205-49e4-88c9-16be4175677e on hv-cinder-83697 Jul 25 16:40:12.309594 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [req-13c1d6f3-0d88-4ac8-ad01-6c1e9db9e504 req-f0dd697d-3371-43cf-bc82-64dba53b0f1a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074927 Jul 25 16:40:12.311755 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 489/1012] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Jul 25 16:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 16:40:13.034322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:13.035961 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:13.048680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:13.049374 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:13.050745 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:13.051537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:13.080549 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e HTTP/1.1 Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:40:13.084322 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:13.087804 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'e0fffa70-0205-49e4-88c9-16be4175677e'} Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:13.091216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:13.097053 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:13.102169 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:13.102169 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-856b3b21-1071-46f3-a007-2020c775d306 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 404 len: 111 microversion: 2.1 time: 0.062046 Jul 25 16:40:13.102169 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 524/1013] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:40:13 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:13.110701 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-2c0fabdc-1eeb-4791-86a8-21a39516868d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '.version_select at 0x7f4410097550>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:13.144663 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-2c0fabdc-1eeb-4791-86a8-21a39516868d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-733179447" status: 202 len: 0 microversion: 2.1 time: 0.043201 Jul 25 16:40:13.145873 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 490/1014] 10.222.0.66 () {58 vars in 1218 bytes} [Mon Jul 25 16:40:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-733179447 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 16:40:15.563466 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:15.564455 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:15.574659 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:15.575514 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:15.577285 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:15.578269 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:15.605784 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e HTTP/1.1 Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:40:15.609395 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.612489 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'e0fffa70-0205-49e4-88c9-16be4175677e'} Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:15.614216 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.617129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.620207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:15.620207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-c991968e-f5b2-4431-adfd-6522b9a27a1a tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 404 len: 111 microversion: 2.1 time: 0.053058 Jul 25 16:40:15.620207 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 525/1015] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:40:15 2022] DELETE /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:15.626110 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:15.627009 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e0fffa70-0205-49e4-88c9-16be4175677e] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:15.637326 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:15.637877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:15.639180 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:15.639887 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:15.658379 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e HTTP/1.1 Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:40:15.660878 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.664036 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'e0fffa70-0205-49e4-88c9-16be4175677e'} Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:15.665059 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. Jul 25 16:40:15.666625 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:15.668013 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance e0fffa70-0205-49e4-88c9-16be4175677e could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:15.668013 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-d7d227f3-c2f9-4bb6-bc91-5f9f76588a9b tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e" status: 404 len: 111 microversion: 2.1 time: 0.043000 Jul 25 16:40:15.668013 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 491/1016] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:40:15 2022] GET /compute/v2.1/servers/e0fffa70-0205-49e4-88c9-16be4175677e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:16.848790 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:16.849595 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:16.856887 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.857424 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.858676 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.859543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.876127 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 HTTP/1.1 Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:40:16.878242 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.881203 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '23ef9254-aaca-4f79-a9c2-7aff5836d680'} Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:16.882832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.885614 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.888220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:16.888220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-4a88cc82-d6e8-4fbf-9de5-8209a4ac483d tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 404 len: 111 microversion: 2.1 time: 0.035946 Jul 25 16:40:16.888220 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 526/1017] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:40:16 2022] DELETE /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:16.893513 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:16.894205 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 23ef9254-aaca-4f79-a9c2-7aff5836d680] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:16.901693 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.902130 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.902964 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.903406 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.920812 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 HTTP/1.1 Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:40:16.922418 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.926593 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '23ef9254-aaca-4f79-a9c2-7aff5836d680'} Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:16.928275 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. Jul 25 16:40:16.931518 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.934012 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance 23ef9254-aaca-4f79-a9c2-7aff5836d680 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:16.934012 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-fbd1abc8-d788-4512-863a-8ece8f6badfa tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680" status: 404 len: 111 microversion: 2.1 time: 0.035859 Jul 25 16:40:16.934012 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 492/1018] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:40:16 2022] GET /compute/v2.1/servers/23ef9254-aaca-4f79-a9c2-7aff5836d680 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:16.936876 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:16.937533 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:16.944552 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.945069 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.946217 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.946775 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.963129 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 HTTP/1.1 Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:40:16.964740 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:16.967155 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'e6d5a977-0b82-421e-bb5d-e8fec6042129'} Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:16.968512 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:16.970911 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:16.973698 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:16.973698 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-a9828a20-6650-4f3c-89ed-bfbc366acf1c tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 404 len: 111 microversion: 2.1 time: 0.034844 Jul 25 16:40:16.973698 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 527/1019] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:40:16 2022] DELETE /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:16.977742 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:16.978555 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: e6d5a977-0b82-421e-bb5d-e8fec6042129] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:16.986283 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.986887 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:16.989063 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:16.989615 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:17.008188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 HTTP/1.1 Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:40:17.009844 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:17.012877 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'e6d5a977-0b82-421e-bb5d-e8fec6042129'} Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:17.014802 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. Jul 25 16:40:17.017989 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:17.020869 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance e6d5a977-0b82-421e-bb5d-e8fec6042129 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:17.020869 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-917677e5-d7f4-421c-ad6b-6bfceca16512 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129" status: 404 len: 111 microversion: 2.1 time: 0.039677 Jul 25 16:40:17.020869 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 493/1020] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:40:16 2022] GET /compute/v2.1/servers/e6d5a977-0b82-421e-bb5d-e8fec6042129 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:18.240099 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:18.241119 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.compute.api [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117919) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:18.250603 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:18.251215 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:18.252206 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:18.252698 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG oslo_concurrency.lockutils [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:18.274012 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 HTTP/1.1 Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:40:18.275993 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: > Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.278954 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': '05732003-19e7-4e32-83f9-a73b782ef373'} Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:18.280543 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.283832 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.286850 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:18.286850 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-5bd22847-3a13-4380-ac27-8310759b1d6f tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 404 len: 111 microversion: 2.1 time: 0.044354 Jul 25 16:40:18.286850 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 528/1021] 10.222.0.66 () {58 vars in 1239 bytes} [Mon Jul 25 16:40:18 2022] DELETE /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:18.290511 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Calling method '>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:18.291346 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.compute.api [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] [instance: 05732003-19e7-4e32-83f9-a73b782ef373] Fetching instance by UUID {{(pid=117920) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 16:40:18.299223 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:18.299791 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:18.300528 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 16:40:18.300937 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG oslo_concurrency.lockutils [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Lock "ec033dab-0f8c-47c8-bceb-c0e2b3df3ae3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117920) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 16:40:18.316648 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] HTTP exception thrown: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Request method failure captured: Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 HTTP/1.1 Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sZwjJTSVOpcme9mKV60SYiJ3HhikP95lSxJeBqw8fUHJJxZdBjz2DRrltbK84rx5P0tv0zcpRxJODeLan2j1zbyZSk78ZWTDb_7_gXB1GR4rwO1ftbzy6Q8JYoU3o_QgsMNdRxkAdjVgRAb51E34pb8cWpJv2LGqG8T_Pf4u4jNxR4 Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:40:18.318272 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7ad628e26f9349e59d73f6606242d957"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7ad628e26f9349e59d73f6606242d957"}]}] Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 7ad628e26f9349e59d73f6606242d957 Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1017488209 Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 1f86305f296440bcae5268e1a0c8b089 Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-AttachVolumeNegativeTest-1017488209-project Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: > Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.321478 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': '05732003-19e7-4e32-83f9-a73b782ef373'} Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:18.323188 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. Jul 25 16:40:18.325957 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:18.329389 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] Returning 404 to user: Instance 05732003-19e7-4e32-83f9-a73b782ef373 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:18.329389 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-47c4d399-08a0-4454-af84-0f1fd7a8e2c5 tempest-AttachVolumeNegativeTest-1017488209 tempest-AttachVolumeNegativeTest-1017488209-project] 10.222.0.66 "GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373" status: 404 len: 111 microversion: 2.1 time: 0.034407 Jul 25 16:40:18.329389 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 494/1022] 10.222.0.66 () {58 vars in 1236 bytes} [Mon Jul 25 16:40:18 2022] GET /compute/v2.1/servers/05732003-19e7-4e32-83f9-a73b782ef373 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:40:25.209953 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-89bebc6f-dc98-4a0e-8474-2046dba97cda tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Action: 'create', calling method: .version_select at 0x7f440a652940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-315114304", "metadata": {"Type": "work"}}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-89bebc6f-dc98-4a0e-8474-2046dba97cda tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Request method failure captured: Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 121 Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sd4Qd7kaZMO5ZjyJr9a1n4Pz7YvCh2_OAqIhNzutW4cUnzlmJYimvuHoWVKINtP8_eOpz-LZDsQ53ucHy3MxyE1o6Ct0C4k8dwpovOj74zpT-4-s6aWebXxtsfp57Tk95OLFzU7xCC5IHHUTzbOpVRSMiBw23XQ0sW7HL-ATjCTwxw Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:40:25.239680 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f2b5f69683944aab36e1ab4e00dc05a"}]}] Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 8adffff6990840f0b2e4e611a762394d Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-315114304", "metadata": {"Type": "work"}}} Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: Jul 25 16:40:25.242597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-315114304', 'metadata': {'Type': 'work'}}}} Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:25.244332 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:40:25.247537 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:40:25.250370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 16:40:25.250370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.250370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-89bebc6f-dc98-4a0e-8474-2046dba97cda tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:25.250370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-89bebc6f-dc98-4a0e-8474-2046dba97cda tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.233527 Jul 25 16:40:25.250370 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 529/1023] 10.222.0.66 () {60 vars in 1156 bytes} [Mon Jul 25 16:40:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:40:25.256128 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3962069b-525b-42fe-b5e5-3486338d28b4 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Action: 'create', calling method: .version_select at 0x7f441008b1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-882285648", "metadata": {"Type": "work"}}} {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3962069b-525b-42fe-b5e5-3486338d28b4 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Request method failure captured: Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 119 Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sd4Qd7kaZMO5ZjyJr9a1n4Pz7YvCh2_OAqIhNzutW4cUnzlmJYimvuHoWVKINtP8_eOpz-LZDsQ53ucHy3MxyE1o6Ct0C4k8dwpovOj74zpT-4-s6aWebXxtsfp57Tk95OLFzU7xCC5IHHUTzbOpVRSMiBw23XQ0sW7HL-ATjCTwxw Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:40:25.261422 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f2b5f69683944aab36e1ab4e00dc05a"}]}] Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 8adffff6990840f0b2e4e611a762394d Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-882285648", "metadata": {"Type": "work"}}} Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: Jul 25 16:40:25.264026 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-882285648', 'metadata': {'Type': 'work'}}}} Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi '0' Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:25.265926 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:40:25.268783 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:40:25.271578 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 16:40:25.271578 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.271578 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-3962069b-525b-42fe-b5e5-3486338d28b4 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:25.271578 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-3962069b-525b-42fe-b5e5-3486338d28b4 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011426 Jul 25 16:40:25.271578 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 495/1024] 10.222.0.66 () {60 vars in 1156 bytes} [Mon Jul 25 16:40:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 16:40:25.274781 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-73715abe-f4c8-4242-a292-e1a1233eb9de tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Action: 'create', calling method: .version_select at 0x7f440a651e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-765888923", "metadata": {"Type": "work"}}} {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-73715abe-f4c8-4242-a292-e1a1233eb9de tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Request method failure captured: Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 118 Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sd4Qd7kaZMO5ZjyJr9a1n4Pz7YvCh2_OAqIhNzutW4cUnzlmJYimvuHoWVKINtP8_eOpz-LZDsQ53ucHy3MxyE1o6Ct0C4k8dwpovOj74zpT-4-s6aWebXxtsfp57Tk95OLFzU7xCC5IHHUTzbOpVRSMiBw23XQ0sW7HL-ATjCTwxw Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:40:25.280819 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f2b5f69683944aab36e1ab4e00dc05a"}]}] Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 8adffff6990840f0b2e4e611a762394d Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-765888923", "metadata": {"Type": "work"}}} Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: Jul 25 16:40:25.283761 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-765888923', 'metadata': {'Type': 'work'}}}} Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise error Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi '' Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:25.285431 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 16:40:25.288190 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 16:40:25.290611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 16:40:25.290611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.290611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-73715abe-f4c8-4242-a292-e1a1233eb9de tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:25.290611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-73715abe-f4c8-4242-a292-e1a1233eb9de tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012750 Jul 25 16:40:25.290611 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 530/1025] 10.222.0.66 () {60 vars in 1156 bytes} [Mon Jul 25 16:40:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 16:40:25.297081 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-53df878d-37dd-4736-9843-49f2d977dce2 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Calling method '.version_select at 0x7f440adcbe50>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:25.332138 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-53df878d-37dd-4736-9843-49f2d977dce2 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] HTTP exception thrown: Volume tempest-invalid-1319780628 could not be found. Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-53df878d-37dd-4736-9843-49f2d977dce2 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Request method failure captured: Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1319780628 HTTP/1.1 Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sd4Qd7kaZMO5ZjyJr9a1n4Pz7YvCh2_OAqIhNzutW4cUnzlmJYimvuHoWVKINtP8_eOpz-LZDsQ53ucHy3MxyE1o6Ct0C4k8dwpovOj74zpT-4-s6aWebXxtsfp57Tk95OLFzU7xCC5IHHUTzbOpVRSMiBw23XQ0sW7HL-ATjCTwxw Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:40:25.334405 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f2b5f69683944aab36e1ab4e00dc05a"}]}] Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 8adffff6990840f0b2e4e611a762394d Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Volume tempest-invalid-1319780628 could not be found. Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'tempest-invalid-1319780628'} Jul 25 16:40:25.336990 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1319780628 could not be found. (HTTP 404) (Request-ID: req-a755dece-7fdd-4912-83ec-9835e9f7f684) Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.343568 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:40:25.346574 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1319780628 could not be found. Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:25.349184 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1319780628 could not be found. Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1319780628 could not be found. Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-53df878d-37dd-4736-9843-49f2d977dce2 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Returning 404 to user: Volume tempest-invalid-1319780628 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-53df878d-37dd-4736-9843-49f2d977dce2 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1319780628" status: 404 len: 99 microversion: 2.1 time: 0.044378 Jul 25 16:40:25.359325 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 496/1026] 10.222.0.66 () {58 vars in 1218 bytes} [Mon Jul 25 16:40:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1319780628 => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 25 16:40:25.361259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-d14e58dd-19cf-479b-98ec-d862a3dbc26a tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004830 Jul 25 16:40:25.361259 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 531/1027] 10.222.0.66 () {58 vars in 1140 bytes} [Mon Jul 25 16:40:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 16:40:25.363468 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-1523f4a9-52c6-473d-81bc-a1d1f1dce377 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007361 Jul 25 16:40:25.364668 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 497/1028] 10.222.0.66 () {58 vars in 1137 bytes} [Mon Jul 25 16:40:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 16:40:25.376301 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fe1d2ecf-df63-45cc-a5e3-6464d0840c19 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Calling method '.version_select at 0x7f440a63adc0>' {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:25.409381 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.wsgi [None req-fe1d2ecf-df63-45cc-a5e3-6464d0840c19 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] HTTP exception thrown: Volume b6ce1ce8-c8b0-4ea6-bb69-b307b5563966 could not be found. Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fe1d2ecf-df63-45cc-a5e3-6464d0840c19 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Request method failure captured: Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: request: DELETE /compute/v2.1/os-volumes/b6ce1ce8-c8b0-4ea6-bb69-b307b5563966 HTTP/1.1 Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept: application/json Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Accept-Encoding: identity Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Connection: close Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Length: 0 Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Content-Type: application/json Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Host: 10.222.0.66 Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Openstack-System-Scope: None Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Auth-Token: gAAAAABi3sd4Qd7kaZMO5ZjyJr9a1n4Pz7YvCh2_OAqIhNzutW4cUnzlmJYimvuHoWVKINtP8_eOpz-LZDsQ53ucHy3MxyE1o6Ct0C4k8dwpovOj74zpT-4-s6aWebXxtsfp57Tk95OLFzU7xCC5IHHUTzbOpVRSMiBw23XQ0sW7HL-ATjCTwxw Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Id: None Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Domain-Name: None Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Identity-Status: Confirmed Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Is-Admin-Project: True Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Id: default Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Domain-Name: Default Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Project-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Role: reader,member Jul 25 16:40:25.411539 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Roles: reader,member Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f2b5f69683944aab36e1ab4e00dc05a"}]}] Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-Tenant-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Id: default Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Domain-Name: Default Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Id: 8adffff6990840f0b2e4e611a762394d Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: X-User-Name: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: method: Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: exception: Volume b6ce1ce8-c8b0-4ea6-bb69-b307b5563966 could not be found. Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: action_args: {'id': 'b6ce1ce8-c8b0-4ea6-bb69-b307b5563966'} Jul 25 16:40:25.413838 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: {{(pid=117919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6ce1ce8-c8b0-4ea6-bb69-b307b5563966 could not be found. (HTTP 404) (Request-ID: req-70bfae0f-8a5e-4c0e-8159-854360562350) Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.415261 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 16:40:25.416597 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6ce1ce8-c8b0-4ea6-bb69-b307b5563966 could not be found. Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 16:40:25.418452 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6ce1ce8-c8b0-4ea6-bb69-b307b5563966 could not be found. Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6ce1ce8-c8b0-4ea6-bb69-b307b5563966 could not be found. Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: DEBUG nova.api.openstack.wsgi [None req-fe1d2ecf-df63-45cc-a5e3-6464d0840c19 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Returning 404 to user: Volume b6ce1ce8-c8b0-4ea6-bb69-b307b5563966 could not be found. {{(pid=117919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO nova.api.openstack.requestlog [None req-fe1d2ecf-df63-45cc-a5e3-6464d0840c19 tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/b6ce1ce8-c8b0-4ea6-bb69-b307b5563966" status: 404 len: 109 microversion: 2.1 time: 0.042048 Jul 25 16:40:25.419871 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: [pid: 117919|app: 0|req: 532/1029] 10.222.0.66 () {58 vars in 1248 bytes} [Mon Jul 25 16:40:25 2022] DELETE /compute/v2.1/os-volumes/b6ce1ce8-c8b0-4ea6-bb69-b307b5563966 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 16:40:25.426817 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9845755a-9a31-4b4f-b26c-5355b4e7364e tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Calling method '.version_select at 0x7f440ae6e310>' {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 16:40:25.463435 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.wsgi [None req-9845755a-9a31-4b4f-b26c-5355b4e7364e tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] HTTP exception thrown: Volume b07b1bd8-0e79-4e19-b8dc-0afc97c442b2 could not be found. Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9845755a-9a31-4b4f-b26c-5355b4e7364e tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Request method failure captured: Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: request: GET /compute/v2.1/os-volumes/b07b1bd8-0e79-4e19-b8dc-0afc97c442b2 HTTP/1.1 Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept: application/json Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Accept-Encoding: identity Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Connection: close Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Length: 0 Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Content-Type: application/json Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Host: 10.222.0.66 Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Openstack-System-Scope: None Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: User-Agent: python-urllib3/1.26.10 Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Auth-Token: gAAAAABi3sd4Qd7kaZMO5ZjyJr9a1n4Pz7YvCh2_OAqIhNzutW4cUnzlmJYimvuHoWVKINtP8_eOpz-LZDsQ53ucHy3MxyE1o6Ct0C4k8dwpovOj74zpT-4-s6aWebXxtsfp57Tk95OLFzU7xCC5IHHUTzbOpVRSMiBw23XQ0sW7HL-ATjCTwxw Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Id: None Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Domain-Name: None Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Identity-Status: Confirmed Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Is-Admin-Project: True Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Id: default Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Domain-Name: Default Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Project-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Role: reader,member Jul 25 16:40:25.465976 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Roles: reader,member Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f2b5f69683944aab36e1ab4e00dc05a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f2b5f69683944aab36e1ab4e00dc05a"}]}] Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Id: 4f2b5f69683944aab36e1ab4e00dc05a Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-Tenant-Name: tempest-VolumesNegativeTest-1179563134 Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Id: default Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Domain-Name: Default Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Id: 8adffff6990840f0b2e4e611a762394d Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: X-User-Name: tempest-VolumesNegativeTest-1179563134-project Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: method: Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: exception: Volume b07b1bd8-0e79-4e19-b8dc-0afc97c442b2 could not be found. Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: action_args: {'id': 'b07b1bd8-0e79-4e19-b8dc-0afc97c442b2'} Jul 25 16:40:25.467861 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: {{(pid=117920) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b07b1bd8-0e79-4e19-b8dc-0afc97c442b2 could not be found. (HTTP 404) (Request-ID: req-d8c21702-354f-4000-bdc8-b4ad82c8e18d) Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.469018 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 16:40:25.470679 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b07b1bd8-0e79-4e19-b8dc-0afc97c442b2 could not be found. Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 16:40:25.473396 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b07b1bd8-0e79-4e19-b8dc-0afc97c442b2 could not be found. Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b07b1bd8-0e79-4e19-b8dc-0afc97c442b2 could not be found. Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: ERROR nova.api.openstack.wsgi Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: DEBUG nova.api.openstack.wsgi [None req-9845755a-9a31-4b4f-b26c-5355b4e7364e tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] Returning 404 to user: Volume b07b1bd8-0e79-4e19-b8dc-0afc97c442b2 could not be found. {{(pid=117920) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO nova.api.openstack.requestlog [None req-9845755a-9a31-4b4f-b26c-5355b4e7364e tempest-VolumesNegativeTest-1179563134 tempest-VolumesNegativeTest-1179563134-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/b07b1bd8-0e79-4e19-b8dc-0afc97c442b2" status: 404 len: 109 microversion: 2.1 time: 0.046855 Jul 25 16:40:25.476732 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: [pid: 117920|app: 0|req: 498/1030] 10.222.0.66 () {58 vars in 1245 bytes} [Mon Jul 25 16:40:25 2022] GET /compute/v2.1/os-volumes/b07b1bd8-0e79-4e19-b8dc-0afc97c442b2 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 16:43:17.678359 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:43:17.679119 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Mon Jul 25 16:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:43:24.337424 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:43:24.338401 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Mon Jul 25 16:43:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:44:34.185523 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:44:34.186513 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Mon Jul 25 16:44:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:44:40.079812 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:44:40.080895 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Mon Jul 25 16:44:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:45:08.621244 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:45:08.622234 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Mon Jul 25 16:45:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:45:25.248369 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:45:25.249107 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Mon Jul 25 16:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:46:37.687547 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:46:37.688319 dv-cinder-836973-15-iscsi devstack@n-api.service[117920]: Mon Jul 25 16:46:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 16:46:44.349173 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 16:46:44.350098 dv-cinder-836973-15-iscsi devstack@n-api.service[117919]: Mon Jul 25 16:46:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!